-- Logs begin at Sat 2022-07-02 02:26:01 UTC, end at Sat 2022-07-02 04:03:10 UTC. -- Jul 02 03:25:26.004331 dv-cinder-846842-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 02 03:25:26.013496 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 2 03:25:26 2022] *** Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: nodename: dv-cinder-846842-9-iscsi Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: machine: x86_64 Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: clock source: unix Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: pcre jit disabled Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: detected number of CPU cores: 4 Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: current working directory: / Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: detected binary path: /usr/bin/uwsgi-core Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: your processes number limit is 47680 Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: your memory page size is 4096 bytes Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: detected max file descriptor number: 2048 Jul 02 03:25:26.015511 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: lock engine: pthread robust mutexes Jul 02 03:25:26.016451 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: thunder lock: enabled Jul 02 03:25:26.016451 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 02 03:25:26.016451 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 02 03:25:26.058601 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: Python main interpreter initialized at 0x5571cc9059c0 Jul 02 03:25:26.058601 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: python threads support enabled Jul 02 03:25:26.058601 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: your server socket listen backlog is limited to 100 connections Jul 02 03:25:26.058601 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: your mercy for graceful operations on workers is 90 seconds Jul 02 03:25:26.058952 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: mapped 403077 bytes (393 KB) for 2 cores Jul 02 03:25:26.058952 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: *** Operational MODE: preforking *** Jul 02 03:25:26.059246 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: *** uWSGI is running in multiple interpreter mode *** Jul 02 03:25:26.059246 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: spawned uWSGI master process (pid: 103498) Jul 02 03:25:26.059469 dv-cinder-846842-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 02 03:25:26.060130 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: spawned uWSGI worker 1 (pid: 103499, cores: 1) Jul 02 03:25:26.060318 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: spawned uWSGI worker 2 (pid: 103500, cores: 1) Jul 02 03:25:26.060426 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 02 03:25:26.709397 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 03:25:26.711184 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 03:25:27.821504 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:25:27.821504 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: from cryptography.utils import int_from_bytes Jul 02 03:25:27.822147 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:25:27.822147 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: from cryptography.utils import int_from_bytes Jul 02 03:25:27.822521 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:25:27.822521 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: from cryptography.utils import int_from_bytes Jul 02 03:25:27.822633 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:25:27.822633 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: from cryptography.utils import int_from_bytes Jul 02 03:25:30.278079 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 03:25:30.278761 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 03:25:30.279116 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 03:25:30.279198 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 03:25:30.279276 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 03:25:30.279386 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 03:25:30.279468 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 03:25:30.279536 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 03:25:30.279600 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 03:25:30.279664 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 03:25:30.279821 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.279964 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.280104 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.280209 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.280452 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.280596 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.280771 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.280959 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.281094 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.281212 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.281362 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.281508 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.281685 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.281779 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.282017 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.282165 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.282340 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.282483 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.282578 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.282664 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.282896 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.283033 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.283214 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-9-iscsi {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.283399 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-9-iscsi {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.283539 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.283635 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.283861 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.284089 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.284266 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.284457 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.284635 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.284821 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.284990 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.285114 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.285233 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.285363 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.285492 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.285617 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.285813 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.286000 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.286250 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.286408 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.286521 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.286624 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.286847 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.287040 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.287159 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.287265 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.287544 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.287664 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.287869 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.288009 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.288132 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.288259 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.288435 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.288572 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.288755 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.288890 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.289050 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.289183 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.289448 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-9-iscsi {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.289575 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-9-iscsi {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.289754 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.289901 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.290108 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.290251 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.290402 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.290521 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.290823 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.291082 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.291208 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.291359 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.291499 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.291616 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.291775 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.291889 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.292056 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.292183 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.292341 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.292437 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.292670 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.292800 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.292983 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.293086 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.293295 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.293391 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.293608 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.293696 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.293910 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.294005 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.294210 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.294345 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.294507 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.294632 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.294834 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.294963 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.295132 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.295266 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.295458 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.295583 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.295717 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.295838 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.295957 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.296085 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.296292 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.296427 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.296606 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.296736 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.296923 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.297060 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.297184 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.297315 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.297525 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.297648 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.297791 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.297931 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.298053 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.298173 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.298294 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.298422 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.298575 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.298707 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.298887 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.299019 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.299188 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.299359 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.299494 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.299614 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.299785 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.299934 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.300104 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.300243 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.300394 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.300518 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.300713 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.300838 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.301025 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.301150 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.301339 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.301462 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.301642 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.301775 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.301960 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.302091 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.302341 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.302467 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.302586 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.302704 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.302866 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.303026 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.303224 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.303424 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.303549 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.303669 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.303860 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.303994 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.304176 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.304312 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.304497 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.304632 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.304809 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.304935 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.305115 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.305241 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.305416 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.305551 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.305731 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.305867 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.306381 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.306510 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.306691 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.306827 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.306949 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.307067 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.307195 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.307347 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.307528 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.307663 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.307843 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.307981 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.308140 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.308261 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.308438 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.308575 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.308724 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.308848 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.309033 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.309157 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.309334 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.309458 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.309631 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.309770 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.309921 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.310046 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.310235 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.310371 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.310529 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.310661 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.310833 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.310964 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.311123 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.311249 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.311449 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.311568 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.311746 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.311893 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.312030 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.312150 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.312354 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.312489 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.312660 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.312792 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.312967 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.313091 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.313260 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.313394 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.313527 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.313646 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.313859 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.313986 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.314158 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.314287 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.314471 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.314598 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.314777 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.314901 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.315079 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.315205 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.315394 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.315521 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.315715 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.315838 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.316005 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.316130 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.316304 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.316445 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.316615 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.316747 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.316903 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.317021 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.317235 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.317373 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.317495 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.317614 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.317780 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.317905 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.318084 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.318217 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.318367 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.318493 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.318718 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.318897 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.319022 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.319152 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.319272 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.319417 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.319613 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.319751 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.319881 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.320001 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.320194 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.320320 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.320510 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.320644 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.320823 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.320955 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.321113 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.321243 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.321427 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.321554 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.321717 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.321841 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.322038 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.322163 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:25:30.322371 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.322496 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.322702 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.322834 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.323038 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.323162 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.323377 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.323520 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.323708 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.323835 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.324041 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.324167 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.324360 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.324499 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.324676 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.324811 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.324989 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.325122 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.325310 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.325445 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.325626 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.325755 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.325929 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.326060 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.326241 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.326365 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.326547 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.326672 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.326857 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.327001 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.327183 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.327364 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.327487 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.327616 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.327821 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.327948 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.328137 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.328262 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.328441 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.328567 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.328755 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.328880 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.329075 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.329200 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.329391 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.329535 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.329684 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.329810 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.330033 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.330160 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.330356 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.330478 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.330663 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.330784 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.330982 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.331114 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.331314 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.331440 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.331628 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.331763 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.331935 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.332058 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.332239 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.332368 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.332557 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.332689 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.332882 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.333005 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.333188 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.333318 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.333500 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.333631 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.333805 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.333926 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.334109 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.334266 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.334454 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.334587 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.334764 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.335052 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.335179 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.335358 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.335481 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.335616 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.335738 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.335856 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.336041 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.336165 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.336350 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.336476 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.336664 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.336787 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.336974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.337097 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.337281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.337416 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.337587 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.337710 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.337895 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.338028 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.338227 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.338351 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.338482 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.338605 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.338786 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.338909 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.339086 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.339374 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.339498 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.339616 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.339735 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.339873 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.340025 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.340159 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.340352 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.340475 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.340650 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.340785 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.340956 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.341080 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.341261 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.341382 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.341564 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.341694 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.341865 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.341987 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.342168 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.342298 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.342475 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.342606 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.342772 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.342894 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.343090 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.343221 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.343422 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.343549 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.343725 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.343858 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.344041 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.344166 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.344341 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.344468 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.344640 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.344761 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.344944 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.345066 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.345249 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.345374 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.345556 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.345680 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.345861 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.345998 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.346166 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.346296 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.346486 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.346610 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.346794 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.346924 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.347098 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.347219 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.347448 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.347584 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.347779 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.347917 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.348078 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.348207 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.348400 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.348533 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.348720 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.348856 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.349033 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.349163 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.349328 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.349450 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.349635 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.349773 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.350114 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.350243 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.350438 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.350605 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.350746 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.350868 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.350989 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.351107 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.351231 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.351457 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.351604 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.351727 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.351852 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.351981 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.352102 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.352227 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.352356 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.352477 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.352628 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.352751 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.352934 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.353064 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.353231 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.353354 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.353530 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.353662 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.353829 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.353960 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.354164 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.354286 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.354468 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.354600 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.354805 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.354937 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.355136 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.355268 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.355477 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.355611 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.355794 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.355927 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.356100 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.356230 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.356410 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.356540 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.356719 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.356852 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.357026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.357147 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.357328 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.357456 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.357633 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.357755 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.357951 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.358081 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.358255 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.358377 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.358572 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.358688 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.358879 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.359002 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.359196 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.359447 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.359583 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.359749 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.359883 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.360004 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.360122 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.360240 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.360416 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.360532 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.360751 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.360879 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.361076 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.361201 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.361387 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.361511 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.361701 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.361831 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.362005 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.362135 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.362313 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.362443 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.362618 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.362750 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.362925 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.363055 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.363225 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.363367 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.363556 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.363680 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.363871 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.364002 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.364178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.364303 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.364490 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.364615 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.364792 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.364928 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.365110 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.365231 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.365411 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.365576 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.365749 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.365874 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.366047 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.366168 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.366353 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.366481 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.366679 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.366799 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.366992 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.367126 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.367353 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.367480 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.367614 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.367735 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.367934 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.368049 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.368240 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.368361 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.368548 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.368671 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.368853 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.368975 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.369155 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.369276 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.369456 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.369579 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.369763 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.369885 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.370072 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.370203 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.370379 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.370501 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.370689 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.370811 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.370990 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.371120 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.371352 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.371482 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.371621 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.371740 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.371920 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.372051 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.372216 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.372338 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.372526 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.372648 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.372846 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.372977 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.373153 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.373283 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.373472 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.373593 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.373787 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.373910 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.374087 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.374209 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.374388 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.374516 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.374706 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.374836 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.375014 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.375138 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.375330 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.375456 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.375634 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.375757 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.375933 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.376057 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.376270 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.376392 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.376576 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.376699 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.376876 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.376998 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.377187 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.377317 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.377503 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.377633 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.377812 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.377935 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.378124 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.378255 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.378432 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.378554 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.378739 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.378860 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.379058 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.379190 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.379396 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.379533 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.379705 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.379826 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.379997 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.380127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.380307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.380431 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.380611 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.380733 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.380916 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.381040 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.381283 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.381415 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.381640 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.381770 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.381955 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.382079 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.382265 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.382390 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.382569 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.382691 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.382877 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.383013 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.383198 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.383361 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.383786 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.383910 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.384117 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.384249 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.384429 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.384552 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.384746 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.384876 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.385061 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.385183 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.385375 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.385499 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.385702 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.385837 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.386029 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.386151 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.386369 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.386500 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.386671 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.386803 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.386976 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.387106 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.387279 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.387443 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.387603 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.387737 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.387909 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.388040 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.388209 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.388339 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.388510 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.388633 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.388807 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.388937 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.389112 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.389233 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.389408 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.389530 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.389706 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.389838 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.390003 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.390124 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.390300 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.390423 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.390609 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.390809 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.390932 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.391050 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.391202 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.391347 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.391526 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.391650 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.391842 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.391972 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.392146 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.392279 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.392444 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.392567 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.392742 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.392865 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.393038 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.393160 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.393375 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.393499 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.393674 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.393795 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.394005 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.394129 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.394328 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.394451 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.394663 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.394796 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.394964 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.395098 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.395262 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.395435 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.395603 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.395723 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.395892 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.396030 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.396189 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.396311 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.396486 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.396616 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.396815 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.396954 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.397123 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.397290 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.397535 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.397659 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.397852 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.397976 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.398163 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.398285 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.398466 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.398588 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.398774 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.398899 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.399072 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.399195 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.399403 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.399526 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.399702 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.399826 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.400014 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.400137 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.400319 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.400443 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.400619 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.400744 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.400918 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.401039 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.401222 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.401345 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.401526 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.401648 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.401824 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.401946 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.402131 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.402261 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.402427 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.402549 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.402743 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.402866 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.403044 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.403174 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.403364 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.403491 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.403665 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.403787 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.403969 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.404101 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.404274 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.404433 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.404556 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.404676 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.404875 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.405007 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.405181 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.405313 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.405480 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.405605 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.405808 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.405943 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.406064 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.406185 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.406366 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.406491 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.406662 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.406785 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.406963 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.407093 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.407282 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.407430 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.407618 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.407750 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.407921 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.408043 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.408229 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.408353 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.408534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.408656 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.408833 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.408949 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.409133 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.409278 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.409440 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.409575 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.409736 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.409858 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.410032 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.410167 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.410326 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.410467 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.410623 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.410757 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.410921 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.411045 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.411234 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.411404 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.411565 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.411700 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.411868 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.412002 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.412165 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.412287 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.412534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.412660 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.412938 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.413063 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.413244 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.413374 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.413601 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.413724 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.413905 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.414029 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.414219 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.414349 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.414536 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.414659 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.414844 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.414968 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.415152 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.415274 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.415491 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.415612 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.415789 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.415914 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.416103 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.416226 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.416411 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.416544 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.416722 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.416843 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.417021 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.417145 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.417323 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.417455 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.417642 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.417768 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.417951 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.418074 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.418249 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.418378 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.418559 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.418683 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.418880 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.419009 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.419199 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.419454 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.419579 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.419698 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.419818 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.419936 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.420114 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.420247 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.420420 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.420541 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.420724 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.420854 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.421030 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.421154 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.421335 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.421457 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.421642 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.421766 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.421950 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.422073 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.422255 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.422385 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.422562 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.422684 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.422869 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.422992 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.423179 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.423326 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.423512 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.423647 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.423815 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.423939 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.424137 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.424268 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.424443 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.424578 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.424743 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.424865 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.425048 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.425170 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.425351 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.425482 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.425657 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.425778 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.425958 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.426081 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.426378 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.426512 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.426686 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.426810 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.426993 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.427117 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.427328 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.427455 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.427623 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.427746 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.427934 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.428095 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.428273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.428396 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.428586 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.428821 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.428955 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.429132 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.429286 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.429555 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.429680 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.429870 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.429994 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.430183 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.430316 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.430485 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.430608 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.430787 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.430909 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.431432 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.431567 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.431747 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.431878 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.432049 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.432171 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.432353 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.432477 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.432657 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.432782 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.432960 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.433090 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.433270 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.433405 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.433577 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.433707 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.433925 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.434056 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.434284 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.434408 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.434588 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.434712 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.434928 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.435063 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.435333 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.435470 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.435625 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.435756 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.435949 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.436082 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.436270 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.436394 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.436590 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.436718 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.436890 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.437026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.437203 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.437339 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.437511 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.437648 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.437819 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.437943 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.438147 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.438278 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.438455 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.438579 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.438764 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.438886 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.439065 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.439195 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.439398 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.439532 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.439718 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.439841 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.440031 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.440157 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.440344 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.440466 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.440666 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.440791 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.441053 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.441181 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.441360 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.441478 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.441681 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.441805 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.442002 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.442129 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.442306 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.442430 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.442612 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.442743 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.442914 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.443037 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.443216 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.443377 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.443548 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.443754 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.443924 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.444047 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.444252 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.444428 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.444559 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.444743 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.444877 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.445058 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.445183 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.445370 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.445494 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.445677 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.445801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.445980 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.446105 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.446304 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.446429 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.446607 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.446739 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.446930 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.447053 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.447243 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.447386 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.447590 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.447713 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.447912 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.448041 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.448217 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.448349 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.448537 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.448661 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.448844 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.448966 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.449147 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.449278 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.449450 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.449565 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.449749 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.449872 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.450090 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.450222 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.450396 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.450526 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.450710 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.450832 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.451038 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.451166 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.451418 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.451542 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.451686 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.451820 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.452017 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.452143 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.452340 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.452465 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.452654 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.452778 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.452971 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.453095 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.453289 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.453412 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.453591 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.453717 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.453893 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.454017 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.454200 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.454324 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.454502 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.454637 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.454805 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.454928 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.455103 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.455225 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.455435 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.455575 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.455738 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.455861 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.456037 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.456159 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.456336 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.456471 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.456652 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.456774 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.456950 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.457073 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.457268 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.457401 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.457573 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.457696 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.457874 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.457996 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.458174 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.458304 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.458474 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.458596 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.458809 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.458933 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.459098 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.459221 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.459474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.459598 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.459787 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.459911 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.460106 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.460250 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.460438 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.460591 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.460737 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.460880 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.461059 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.461190 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.461377 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.461501 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.461692 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.461829 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.462012 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.462136 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.462331 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.462454 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.462646 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.462778 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.462960 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.463085 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.463275 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.463417 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.463610 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.463751 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.463924 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.464049 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.464237 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.464361 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.464550 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.464680 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.465062 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.465195 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.465388 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.465517 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.465698 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.465829 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.466007 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.466128 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.466312 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.466442 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.466647 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.466768 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.466897 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.467029 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.467209 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.467352 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.467545 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.467683 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.467857 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.467989 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.468165 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.468288 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.468488 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.468613 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.468807 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.468930 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.469126 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.469266 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.469455 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.469578 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.469765 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.469886 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.470077 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.470210 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.470388 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.470513 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.470698 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.470822 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.471049 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.471176 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.471385 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.471511 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.471695 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.471819 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.472005 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.472129 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.472316 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.472438 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.472628 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.472755 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.472932 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.473055 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.473240 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.473375 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.473548 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.473747 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.473870 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.473993 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.474153 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.474277 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.474459 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.474591 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.474766 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.474973 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.475148 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.475279 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.475513 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.475630 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.475847 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.475972 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.476168 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.476295 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.476485 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.476609 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.476799 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.476923 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.477115 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.477238 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.477631 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.477756 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.477946 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.478071 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.478279 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.478415 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.478602 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.478733 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.478923 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.479053 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.479393 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.479640 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.479749 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.479861 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.479988 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.480101 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.480220 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.480348 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.480469 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.480597 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.480726 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.480846 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.481033 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.481171 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.481336 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.481460 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.481656 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.481785 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.481961 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.482086 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.482264 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.482387 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.482581 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.482711 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.482887 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.483012 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.483436 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.483562 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.483785 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.483908 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.484110 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.484242 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.484440 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.484564 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.484760 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.484882 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.485077 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.485201 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.485380 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.485502 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.485699 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.485837 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.486005 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.486129 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.486308 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.486430 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.486616 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.486750 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.486922 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.487046 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.487223 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.487376 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.487551 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.487687 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.487860 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.487982 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.488165 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.488301 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.488468 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.488603 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.488771 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.488894 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.489071 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.489289 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.489426 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.489547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.489667 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.489787 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.489963 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.490096 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.490265 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.490391 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.490621 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.490747 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.490929 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.491063 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.491234 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.491420 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.491566 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.491734 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.491858 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.492044 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.492186 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.492361 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.492495 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.492668 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.492799 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.492980 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.493104 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.493288 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.493412 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.493603 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.493726 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.493907 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.494030 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.494220 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.494343 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.494562 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.494686 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.494867 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.494999 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.495170 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.495325 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.495498 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.495622 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.495805 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.495936 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.496114 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.496251 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.496422 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.496554 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.496730 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.496855 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.497041 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.497170 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.497375 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.497506 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.497695 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.497911 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.498226 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.498350 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.498549 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.498679 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.498873 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.498995 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.499196 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.499339 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.499529 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.499663 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.499834 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.499959 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.500138 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.500261 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.500444 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.500570 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.500752 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.500876 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.501058 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.501189 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.501364 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.501490 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.501673 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.501795 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.501975 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.502106 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.502282 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.502405 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.502583 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.502707 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.502890 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.503082 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.503205 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.503347 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.503520 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.503642 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.503823 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.503958 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.504129 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.504254 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.504434 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.504566 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.504740 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.504872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.505058 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.505182 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.505374 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.505496 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.505686 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.505818 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.505999 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.506154 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.506427 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.506563 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.506746 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.506931 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.507054 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.507253 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.507426 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.507598 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.507738 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.507912 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.508036 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.508223 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.508347 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.508543 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.508682 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.508868 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.508990 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.509181 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.509304 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.509489 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.509613 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.509878 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.510001 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.510197 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.510321 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.510504 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.510630 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.510824 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.510955 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.511135 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.511259 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.511467 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.511592 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.511788 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.511915 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.512095 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.512227 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.512416 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.512539 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.512730 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.512854 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.513061 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.513193 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.513381 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.513504 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.513685 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.513810 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.513988 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.514121 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.514289 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.514420 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.514597 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.514721 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.514901 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.515025 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.515207 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.515377 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.515534 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.515660 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.515835 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.515961 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.516136 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.516258 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.516431 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.516553 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.516731 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.516863 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.517017 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.517139 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.517314 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.517439 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.517615 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.517738 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.517916 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.518040 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.518213 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.518337 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.518509 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.518643 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.518809 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.518933 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.519149 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.519288 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.519434 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.519554 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.519723 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.519848 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.520022 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.520157 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.520321 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.520445 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.520621 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.520745 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.520922 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.521060 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.521222 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.521344 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.521527 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.521652 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.521898 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.522027 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.522283 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.522406 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.522605 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.522737 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.522914 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.523039 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.523233 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.523383 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.523576 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.523700 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.523898 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.524032 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.524211 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.524334 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.524519 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.524642 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.524828 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.524954 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.525141 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.525264 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.525449 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.525580 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.525758 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.525883 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.526067 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.526191 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.526373 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.526506 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.526681 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.526804 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.526989 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.527113 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.527333 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.527472 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.527631 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.527758 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.527944 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.528068 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.528267 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.528392 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.528568 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.528702 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.528887 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.529010 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.529198 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.529321 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.529501 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.529625 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.529823 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.529946 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.530128 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.530254 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.530436 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.530560 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.530748 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.530880 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.531055 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.531178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.531382 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.531507 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.531695 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.531896 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.532020 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.532142 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.532308 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.532433 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.532626 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.532762 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.532934 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.533057 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.533260 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.533385 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.533569 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.533701 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.533897 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.534020 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.534209 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.534331 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.534551 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.534676 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.534864 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.534987 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.535178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.535330 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.535520 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.535647 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.535827 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.535950 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.536070 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 03:25:30.536183 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.536432 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:25:30.536675 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 03:25:30.690408 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO dbcounter [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Registered counter for database nova_api Jul 02 03:25:30.690967 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO dbcounter [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Registered counter for database nova_api Jul 02 03:25:30.712542 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_db.sqlalchemy.engines [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.715116 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_db.sqlalchemy.engines [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.719235 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writer thread running {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:30.721708 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writer thread running {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:30.773996 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.context [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b6b550-82d3-45fa-a0bc-b1fc6381a030(cell1) {{(pid=103499) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 03:25:30.775991 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.context [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b6b550-82d3-45fa-a0bc-b1fc6381a030(cell1) {{(pid=103500) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 03:25:30.777951 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_concurrency.lockutils [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:25:30.779557 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_concurrency.lockutils [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:25:30.779904 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:25:30.780333 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_concurrency.lockutils [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:25:30.781482 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:25:30.782252 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:25:30.782386 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_concurrency.lockutils [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:25:30.784215 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:25:30.784354 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO dbcounter [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Registered counter for database nova_cell0 Jul 02 03:25:30.786183 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO dbcounter [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Registered counter for database nova_cell0 Jul 02 03:25:30.789786 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO dbcounter [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Registered counter for database nova_cell1 Jul 02 03:25:30.791769 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO dbcounter [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Registered counter for database nova_cell1 Jul 02 03:25:30.797946 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_db.sqlalchemy.engines [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.799110 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_db.sqlalchemy.engines [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.804337 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_db.sqlalchemy.engines [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.805183 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_db.sqlalchemy.engines [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.805596 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writer thread running {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:30.808584 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writer thread running {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:30.813376 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writer thread running {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:30.813723 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writer thread running {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:30.953054 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO dbcounter [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Registered counter for database nova_cell0 Jul 02 03:25:30.958321 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO dbcounter [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Registered counter for database nova_cell0 Jul 02 03:25:30.962271 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG oslo_db.sqlalchemy.engines [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.966225 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_db.sqlalchemy.engines [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:25:30.968059 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writer thread running {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:30.970900 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writer thread running {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:25:31.301031 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: WARNING keystonemiddleware.auth_token [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:25:31.308651 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: WARNING keystonemiddleware.auth_token [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:25:31.309358 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: WARNING keystonemiddleware.auth_token [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:25:31.316600 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: WARNING keystonemiddleware.auth_token [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:25:31.643675 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: WARNING keystonemiddleware.auth_token [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:25:31.649616 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: WARNING keystonemiddleware.auth_token [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:25:31.651519 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: WARNING keystonemiddleware.auth_token [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:25:31.654803 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571cc9059c0 pid: 103500 (default app) Jul 02 03:25:31.656875 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:25:31.657413 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: WARNING keystonemiddleware.auth_token [None req-e76983c3-0124-4de3-8b28-dc2ff0850661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:25:31.658079 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Jul 02 03:25:31.658501 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Sat Jul 2 03:25:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:25:31.662712 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571cc9059c0 pid: 103499 (default app) Jul 02 03:26:47.549767 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:26:47.552305 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002983 Jul 02 03:26:47.552875 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:26:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:26:47.570554 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writing DB stats nova_api:SELECT=3 {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:47.572191 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writing DB stats nova_cell1:SELECT=3 {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:47.573265 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writing DB stats nova_cell0:SELECT=3 {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:47.575192 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:48.013569 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-c98d6bc3-3f47-4b30-bc67-f73cd94a3542 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:26:48.043487 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-c98d6bc3-3f47-4b30-bc67-f73cd94a3542 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.483221 Jul 02 03:26:48.044427 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Sat Jul 2 03:26:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:26:50.110517 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:26:50.111729 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-295d999c-c041-4217-b09c-b4b6b61daf35 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 02 03:26:50.115661 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:26:50.182536 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-ac23f805-561f-47e3-9c52-8fa28941a69b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:50.203819 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:26:50.203819 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: warnings.warn(msg) Jul 02 03:26:50.238091 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-ac23f805-561f-47e3-9c52-8fa28941a69b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.119641 Jul 02 03:26:50.239128 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:26:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 03:26:50.461558 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-63debcd6-a67b-4279-b854-71dccf3efc45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:50.464040 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:26:50.464040 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: warnings.warn(msg) Jul 02 03:26:50.466923 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_api:SELECT=3 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:50.467877 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_cell1:SELECT=3 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:50.469123 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_cell0:SELECT=3 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:50.469909 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:26:50.539909 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-63debcd6-a67b-4279-b854-71dccf3efc45 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292370 Jul 02 03:26:50.540522 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Sat Jul 2 03:26:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:26:52.674424 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-ac23f805-561f-47e3-9c52-8fa28941a69b admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:26:52.675538 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-ac23f805-561f-47e3-9c52-8fa28941a69b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002745 Jul 02 03:26:52.675911 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:26:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:26:52.786329 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-fd3619eb-607e-415d-8e77-7d00ca9be33f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:52.803978 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:26:52.803978 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: warnings.warn(msg) Jul 02 03:26:52.823699 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-fd3619eb-607e-415d-8e77-7d00ca9be33f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140758 Jul 02 03:26:52.824458 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:26:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:26:52.836571 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-4738400c-5ce7-44ef-b3f4-4d96e41e5a05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:52.838188 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:26:52.838188 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: warnings.warn(msg) Jul 02 03:26:52.871904 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-4738400c-5ce7-44ef-b3f4-4d96e41e5a05 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039253 Jul 02 03:26:52.872742 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Sat Jul 2 03:26:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:26:54.957252 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-fd3619eb-607e-415d-8e77-7d00ca9be33f admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:26:54.958275 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-fd3619eb-607e-415d-8e77-7d00ca9be33f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 02 03:26:54.958938 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:26:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:26:55.017757 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-87e9b88f-81ea-4563-aa72-b6fe237ac061 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:55.038288 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-87e9b88f-81ea-4563-aa72-b6fe237ac061 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073610 Jul 02 03:26:55.039063 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:26:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 03:26:55.051008 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-e65f13f6-1fdc-430a-8578-c3cee7fe69b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:55.078585 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-e65f13f6-1fdc-430a-8578-c3cee7fe69b6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031325 Jul 02 03:26:55.079378 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Sat Jul 2 03:26:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:26:57.181681 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-87e9b88f-81ea-4563-aa72-b6fe237ac061 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:26:57.182714 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-87e9b88f-81ea-4563-aa72-b6fe237ac061 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 02 03:26:57.187395 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:26:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:26:57.248992 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-a9e93749-739f-453c-a491-8e9111dce37d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "disk": 10}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:57.268269 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-a9e93749-739f-453c-a491-8e9111dce37d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077744 Jul 02 03:26:57.268999 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:26:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:26:57.280843 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-f648a6bd-7a2e-4133-8b49-46812dd11b1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:57.305326 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-f648a6bd-7a2e-4133-8b49-46812dd11b1d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028210 Jul 02 03:26:57.305932 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Sat Jul 2 03:26:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:26:59.407390 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-a9e93749-739f-453c-a491-8e9111dce37d admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:26:59.408568 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-a9e93749-739f-453c-a491-8e9111dce37d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jul 02 03:26:59.409197 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:26:59.468134 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d9fd122c-8588-4e81-b4e7-126b48acb703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G"}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:59.487247 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d9fd122c-8588-4e81-b4e7-126b48acb703 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072145 Jul 02 03:26:59.487909 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:26:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:26:59.499945 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-33d45b61-eba6-4064-8e97-c81704ee470a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:26:59.524767 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-33d45b61-eba6-4064-8e97-c81704ee470a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028540 Jul 02 03:26:59.525343 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Sat Jul 2 03:26:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:27:01.651095 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d9fd122c-8588-4e81-b4e7-126b48acb703 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:01.652145 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d9fd122c-8588-4e81-b4e7-126b48acb703 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 02 03:27:01.652545 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:01.714251 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-c1c9e754-928f-4380-b652-33bc7fad797a admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:01.738044 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-c1c9e754-928f-4380-b652-33bc7fad797a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079261 Jul 02 03:27:01.738597 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Sat Jul 2 03:27:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:27:03.848724 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d9fd122c-8588-4e81-b4e7-126b48acb703 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:03.850484 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d9fd122c-8588-4e81-b4e7-126b48acb703 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Jul 02 03:27:03.851078 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:03.913904 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-b0987d34-9c41-40b7-bdfa-991fa0a821eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:03.945158 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-b0987d34-9c41-40b7-bdfa-991fa0a821eb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087916 Jul 02 03:27:03.945838 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:27:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 03:27:03.960835 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-41cada66-5d4c-42b8-89cb-b252b81d99e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:03.991224 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-41cada66-5d4c-42b8-89cb-b252b81d99e5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035046 Jul 02 03:27:03.992120 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Sat Jul 2 03:27:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:27:06.324898 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-b0987d34-9c41-40b7-bdfa-991fa0a821eb admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:06.325919 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-b0987d34-9c41-40b7-bdfa-991fa0a821eb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 02 03:27:06.326324 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:06.387439 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-1b07262b-f483-4473-9036-5c554fab5e59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "2"}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:06.406927 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-1b07262b-f483-4473-9036-5c554fab5e59 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074135 Jul 02 03:27:06.407519 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:27:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:27:06.419648 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-15537937-0c90-4b77-8375-e283d8bdc709 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:06.445067 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-15537937-0c90-4b77-8375-e283d8bdc709 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029060 Jul 02 03:27:06.445664 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Sat Jul 2 03:27:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:27:08.988309 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-1b07262b-f483-4473-9036-5c554fab5e59 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:08.989471 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-1b07262b-f483-4473-9036-5c554fab5e59 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Jul 02 03:27:08.989867 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:09.051979 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-a1953771-5150-48ef-bc38-36768f527a3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "name": "m1.medium", "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:09.071474 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-a1953771-5150-48ef-bc38-36768f527a3c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073539 Jul 02 03:27:09.072033 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:27:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:27:09.084352 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-086634c2-e145-4944-9056-ad65a439e1ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:09.111325 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-086634c2-e145-4944-9056-ad65a439e1ae admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030711 Jul 02 03:27:09.111951 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Sat Jul 2 03:27:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:27:11.198074 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-a1953771-5150-48ef-bc38-36768f527a3c admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:11.199081 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-a1953771-5150-48ef-bc38-36768f527a3c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 02 03:27:11.199527 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:27:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:11.260181 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-68e14b15-5dde-4a39-b992-164ff35d694b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:11.279731 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-68e14b15-5dde-4a39-b992-164ff35d694b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074439 Jul 02 03:27:11.280292 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:27:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:27:11.292361 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-8544c0e7-238c-4b3d-8676-fb4837969d3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:11.317356 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-8544c0e7-238c-4b3d-8676-fb4837969d3f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028777 Jul 02 03:27:11.317946 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Sat Jul 2 03:27:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:27:13.421264 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-68e14b15-5dde-4a39-b992-164ff35d694b admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:13.422284 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-68e14b15-5dde-4a39-b992-164ff35d694b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 02 03:27:13.422687 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:13.490047 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-366fdeb5-21d4-40f6-8dac-3215a6f57ef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:13.515378 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-366fdeb5-21d4-40f6-8dac-3215a6f57ef4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083250 Jul 02 03:27:13.519515 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Sat Jul 2 03:27:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 03:27:13.528429 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-ef8d8c84-1cae-4815-96ce-8cee46c4629d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:13.556424 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-ef8d8c84-1cae-4815-96ce-8cee46c4629d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031552 Jul 02 03:27:13.557600 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Sat Jul 2 03:27:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:27:37.524537 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-366fdeb5-21d4-40f6-8dac-3215a6f57ef4 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:37.525533 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-366fdeb5-21d4-40f6-8dac-3215a6f57ef4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 02 03:27:37.525927 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:37.539014 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:27:37.599202 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-3fe66997-c18a-4ef7-bc58-3d4710506b5c admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:37.616883 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-3fe66997-c18a-4ef7-bc58-3d4710506b5c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.084937 Jul 02 03:27:37.617415 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Sat Jul 2 03:27:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:27:38.547628 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-366fdeb5-21d4-40f6-8dac-3215a6f57ef4 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:38.549047 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-366fdeb5-21d4-40f6-8dac-3215a6f57ef4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Jul 02 03:27:38.551825 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:38.766356 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-08c8c6a4-cb57-4312-82f6-463cecaba44f admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:38.772824 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.wsgi [None req-08c8c6a4-cb57-4312-82f6-463cecaba44f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-08c8c6a4-cb57-4312-82f6-463cecaba44f admin admin] Request method failure captured: Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Accept: application/json Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Accept-Encoding: gzip, deflate Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Connection: keep-alive Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Content-Length: 0 Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Host: 10.222.0.42 Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Openstack-Api-Version: compute 2.90 Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Openstack-System-Scope: None Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: User-Agent: python-novaclient Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Auth-Token: gAAAAABiv7sqCHgRd3ncPIeggEiOG3sNiXKthYzuGmlstuggr2uR2GCUHOkBmwT1xCGi35Ag37H8BfSPKS_jDLj_tsqi63YlBcWfC4f9cHxTFJawcLrhCuTiUXUn8SMC_gfd914_Sdcvkipspu_JySLiZr4Mprsxu_Wv31pqbPCWZnzLdBpOEK4 Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Domain-Id: None Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Domain-Name: None Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Identity-Status: Confirmed Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Is-Admin-Project: True Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Domain-Id: default Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Domain-Name: Default Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Name: admin Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Role: reader,admin,member Jul 02 03:27:38.776178 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Roles: reader,admin,member Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08e65693c4ea4b43b13797fe93e3a44a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant: admin Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant-Name: admin Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User: admin Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Domain-Id: default Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Domain-Name: Default Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Id: c350860378554603affd063cfacfc453 Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Name: admin Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: method: > Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: exception: Flavor 42 could not be found. Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: action_args: {'id': '42'} Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:27:38.777759 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:38.778849 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.780273 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-08c8c6a4-cb57-4312-82f6-463cecaba44f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:27:38.781495 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-08c8c6a4-cb57-4312-82f6-463cecaba44f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074134 Jul 02 03:27:38.781495 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Sat Jul 2 03:27:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:38.788057 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-8b4f172d-ee3a-40b6-9660-1714fba2de08 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:38.790955 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:27:38.810887 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-8b4f172d-ee3a-40b6-9660-1714fba2de08 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026408 Jul 02 03:27:38.811456 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Sat Jul 2 03:27:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:27:38.822062 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-90bf0af5-39b4-4ff5-89e4-bb057338e720 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:38.848227 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-90bf0af5-39b4-4ff5-89e4-bb057338e720 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029761 Jul 02 03:27:38.848752 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Sat Jul 2 03:27:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:27:38.858729 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-7768e954-f8d1-495c-8619-1db77c67236c admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:38.865885 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.wsgi [None req-7768e954-f8d1-495c-8619-1db77c67236c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-7768e954-f8d1-495c-8619-1db77c67236c admin admin] Request method failure captured: Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Accept: application/json Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Accept-Encoding: gzip, deflate Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Connection: keep-alive Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Content-Length: 0 Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Host: 10.222.0.42 Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Openstack-Api-Version: compute 2.90 Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Openstack-System-Scope: None Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: User-Agent: python-novaclient Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Auth-Token: gAAAAABiv7sqCHgRd3ncPIeggEiOG3sNiXKthYzuGmlstuggr2uR2GCUHOkBmwT1xCGi35Ag37H8BfSPKS_jDLj_tsqi63YlBcWfC4f9cHxTFJawcLrhCuTiUXUn8SMC_gfd914_Sdcvkipspu_JySLiZr4Mprsxu_Wv31pqbPCWZnzLdBpOEK4 Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Domain-Id: None Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Domain-Name: None Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Identity-Status: Confirmed Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Is-Admin-Project: True Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Domain-Id: default Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Domain-Name: Default Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Name: admin Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Role: reader,admin,member Jul 02 03:27:38.869421 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Roles: reader,admin,member Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08e65693c4ea4b43b13797fe93e3a44a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant: admin Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant-Name: admin Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User: admin Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Domain-Id: default Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Domain-Name: Default Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Id: c350860378554603affd063cfacfc453 Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Name: admin Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: method: > Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: exception: Flavor 42 could not be found. Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: action_args: {'id': '42'} Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:27:38.870922 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:38.872125 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:38.873446 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-7768e954-f8d1-495c-8619-1db77c67236c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:27:38.874630 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-7768e954-f8d1-495c-8619-1db77c67236c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016177 Jul 02 03:27:38.874630 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Sat Jul 2 03:27:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:39.708938 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-90bf0af5-39b4-4ff5-89e4-bb057338e720 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:39.709944 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-90bf0af5-39b4-4ff5-89e4-bb057338e720 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 02 03:27:39.710341 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:39.912040 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-abadbb2f-9bf3-4ac5-976f-67d315376764 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:39.918228 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.wsgi [None req-abadbb2f-9bf3-4ac5-976f-67d315376764 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-abadbb2f-9bf3-4ac5-976f-67d315376764 admin admin] Request method failure captured: Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Accept: application/json Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Accept-Encoding: gzip, deflate Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Connection: keep-alive Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Content-Length: 0 Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Host: 10.222.0.42 Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Openstack-Api-Version: compute 2.90 Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Openstack-System-Scope: None Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: User-Agent: python-novaclient Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Auth-Token: gAAAAABiv7sraSLM79fqyMA1QABr5C8a0lZ1ZWpt0DmfkOgMmM_F8yeLplNxklPvBB04W7KTzaAJG9c0omU3BTc_BdUGK5oRfIs8MiRFBin9ls8JEyqygRyqAyLqGGCCQC_K8S3qAZAIg-Vr8SlINTkiF6OEdgYZwWDmtt2BZkZOSU2C4Xrl_fE Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Domain-Id: None Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Domain-Name: None Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Identity-Status: Confirmed Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Is-Admin-Project: True Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Domain-Id: default Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Domain-Name: Default Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Name: admin Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Role: reader,admin,member Jul 02 03:27:39.919789 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Roles: reader,admin,member Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08e65693c4ea4b43b13797fe93e3a44a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant: admin Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant-Name: admin Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User: admin Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Domain-Id: default Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Domain-Name: Default Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Id: c350860378554603affd063cfacfc453 Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Name: admin Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: method: > Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: exception: Flavor 84 could not be found. Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: action_args: {'id': '84'} Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:27:39.921306 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:39.922307 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:39.923801 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-abadbb2f-9bf3-4ac5-976f-67d315376764 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:27:39.925052 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-abadbb2f-9bf3-4ac5-976f-67d315376764 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.074192 Jul 02 03:27:39.925052 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Sat Jul 2 03:27:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:39.931561 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-0d9968c9-024e-4c7a-b768-122159e2f322 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:39.947046 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-0d9968c9-024e-4c7a-b768-122159e2f322 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019438 Jul 02 03:27:39.947633 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Sat Jul 2 03:27:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:27:39.957655 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-99319f12-8cd8-4d06-97b3-dd9528632782 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:39.978749 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-99319f12-8cd8-4d06-97b3-dd9528632782 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024871 Jul 02 03:27:39.979548 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Sat Jul 2 03:27:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:27:39.989211 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-f7fd10fa-6739-4c1c-a199-f5fe65b71084 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:39.995314 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.wsgi [None req-f7fd10fa-6739-4c1c-a199-f5fe65b71084 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-f7fd10fa-6739-4c1c-a199-f5fe65b71084 admin admin] Request method failure captured: Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Accept: application/json Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Accept-Encoding: gzip, deflate Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Connection: keep-alive Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Content-Length: 0 Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Host: 10.222.0.42 Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Openstack-Api-Version: compute 2.90 Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Openstack-System-Scope: None Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: User-Agent: python-novaclient Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Auth-Token: gAAAAABiv7sraSLM79fqyMA1QABr5C8a0lZ1ZWpt0DmfkOgMmM_F8yeLplNxklPvBB04W7KTzaAJG9c0omU3BTc_BdUGK5oRfIs8MiRFBin9ls8JEyqygRyqAyLqGGCCQC_K8S3qAZAIg-Vr8SlINTkiF6OEdgYZwWDmtt2BZkZOSU2C4Xrl_fE Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Domain-Id: None Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Domain-Name: None Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Identity-Status: Confirmed Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Is-Admin-Project: True Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Domain-Id: default Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Domain-Name: Default Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Name: admin Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Role: reader,admin,member Jul 02 03:27:39.996913 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Roles: reader,admin,member Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08e65693c4ea4b43b13797fe93e3a44a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant: admin Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant-Name: admin Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User: admin Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Domain-Id: default Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Domain-Name: Default Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Id: c350860378554603affd063cfacfc453 Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Name: admin Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: method: > Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: exception: Flavor 84 could not be found. Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: action_args: {'id': '84'} Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:27:39.998256 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:39.999127 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:40.000281 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-f7fd10fa-6739-4c1c-a199-f5fe65b71084 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:27:40.001630 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-f7fd10fa-6739-4c1c-a199-f5fe65b71084 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012745 Jul 02 03:27:40.001630 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Sat Jul 2 03:27:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:40.842040 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-99319f12-8cd8-4d06-97b3-dd9528632782 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:40.843553 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-99319f12-8cd8-4d06-97b3-dd9528632782 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Jul 02 03:27:40.844101 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:41.047028 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-6e6ebb92-2065-4380-881a-bd4e7307c274 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:41.053544 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.wsgi [None req-6e6ebb92-2065-4380-881a-bd4e7307c274 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-6e6ebb92-2065-4380-881a-bd4e7307c274 admin admin] Request method failure captured: Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Accept: application/json Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Accept-Encoding: gzip, deflate Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Connection: keep-alive Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Content-Length: 0 Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Host: 10.222.0.42 Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Openstack-Api-Version: compute 2.90 Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Openstack-System-Scope: None Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: User-Agent: python-novaclient Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Auth-Token: gAAAAABiv7ssj5kq186ZIISSmFw6s2DO5eIxVtZu5vkG2bfSaNc1uO2T7rQJvXxxzcuS41WaR1wH6AWKi9W3GRqCxzX_ya47vW2PbNM1uEg4IhKpVqnC7vMcik-Ff62-55HgxBj6otZz-tJD1IqEPlR6kRqo_mAXUU9xjKJtco4qZA3vThMgyvk Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Domain-Id: None Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Domain-Name: None Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Identity-Status: Confirmed Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Is-Admin-Project: True Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Domain-Id: default Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Domain-Name: Default Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Project-Name: admin Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Role: reader,admin,member Jul 02 03:27:41.054974 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Roles: reader,admin,member Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08e65693c4ea4b43b13797fe93e3a44a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant: admin Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-Tenant-Name: admin Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User: admin Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Domain-Id: default Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Domain-Name: Default Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Id: c350860378554603affd063cfacfc453 Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: X-User-Name: admin Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: method: > Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: exception: Flavor 451 could not be found. Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: action_args: {'id': '451'} Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:27:41.056515 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:41.057474 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.058872 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-6e6ebb92-2065-4380-881a-bd4e7307c274 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:27:41.060225 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-6e6ebb92-2065-4380-881a-bd4e7307c274 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075100 Jul 02 03:27:41.060225 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Sat Jul 2 03:27:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:41.066395 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-28a0028e-1efe-468a-abbc-089b081babb6 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:41.082537 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-28a0028e-1efe-468a-abbc-089b081babb6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019931 Jul 02 03:27:41.083077 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Sat Jul 2 03:27:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:27:41.092656 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:41.111034 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021546 Jul 02 03:27:41.112059 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Sat Jul 2 03:27:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:27:41.126797 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-93c61281-6074-40b6-b461-0ec1a06f7c8c admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:41.132492 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.wsgi [None req-93c61281-6074-40b6-b461-0ec1a06f7c8c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-93c61281-6074-40b6-b461-0ec1a06f7c8c admin admin] Request method failure captured: Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Accept: application/json Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Accept-Encoding: gzip, deflate Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Connection: keep-alive Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Content-Length: 0 Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Host: 10.222.0.42 Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Openstack-Api-Version: compute 2.90 Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Openstack-System-Scope: None Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: User-Agent: python-novaclient Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Auth-Token: gAAAAABiv7ssj5kq186ZIISSmFw6s2DO5eIxVtZu5vkG2bfSaNc1uO2T7rQJvXxxzcuS41WaR1wH6AWKi9W3GRqCxzX_ya47vW2PbNM1uEg4IhKpVqnC7vMcik-Ff62-55HgxBj6otZz-tJD1IqEPlR6kRqo_mAXUU9xjKJtco4qZA3vThMgyvk Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Domain-Id: None Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Domain-Name: None Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Identity-Status: Confirmed Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Is-Admin-Project: True Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Domain-Id: default Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Domain-Name: Default Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Project-Name: admin Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Role: reader,admin,member Jul 02 03:27:41.134023 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Roles: reader,admin,member Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08e65693c4ea4b43b13797fe93e3a44a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08e65693c4ea4b43b13797fe93e3a44a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant: admin Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant-Id: 08e65693c4ea4b43b13797fe93e3a44a Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-Tenant-Name: admin Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User: admin Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Domain-Id: default Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Domain-Name: Default Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Id: c350860378554603affd063cfacfc453 Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: X-User-Name: admin Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: method: > Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: exception: Flavor 451 could not be found. Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: action_args: {'id': '451'} Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:27:41.135534 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:41.136547 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: ERROR nova.api.openstack.wsgi Jul 02 03:27:41.138026 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-93c61281-6074-40b6-b461-0ec1a06f7c8c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:27:41.139255 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-93c61281-6074-40b6-b461-0ec1a06f7c8c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014115 Jul 02 03:27:41.139255 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Sat Jul 2 03:27:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:41.958183 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:41.959201 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 02 03:27:41.959627 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:42.160137 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-4512967e-4af3-4dfe-a792-a28ecb875535 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:42.181041 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-4512967e-4af3-4dfe-a792-a28ecb875535 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083917 Jul 02 03:27:42.181582 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Sat Jul 2 03:27:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 03:27:43.011954 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:43.012957 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 02 03:27:43.013344 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:43.205871 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-e1ae87f1-79a5-43f0-a701-aa7f0b84b2d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:43.224589 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-e1ae87f1-79a5-43f0-a701-aa7f0b84b2d5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074276 Jul 02 03:27:43.225047 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Sat Jul 2 03:27:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:27:44.056693 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:44.057729 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 02 03:27:44.058131 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:44.268310 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-d5376c9a-e322-4d10-993c-8d63f3af15d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:44.291012 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-d5376c9a-e322-4d10-993c-8d63f3af15d2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.091731 Jul 02 03:27:44.291661 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Sat Jul 2 03:27:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:27:45.138501 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:45.139790 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001867 Jul 02 03:27:45.140312 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:45.346139 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-807038c9-9265-43ce-9014-d41b7e207db6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:27:45.365893 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-807038c9-9265-43ce-9014-d41b7e207db6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.079584 Jul 02 03:27:45.366424 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Sat Jul 2 03:27:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:27:46.183307 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:46.184324 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 02 03:27:46.184754 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:27:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:27:46.382347 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-77e509d0-67a9-444f-8708-1e562c762155 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:27:46.401494 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-77e509d0-67a9-444f-8708-1e562c762155 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081865 Jul 02 03:27:46.402035 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Sat Jul 2 03:27:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:28:33.528165 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:28:33.529173 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-d1a640f7-e1b8-4e77-ac05-f7220e555f05 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 02 03:28:33.529569 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Sat Jul 2 03:28:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:28:33.540491 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:28:33.589493 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-d8f2846c-a2ba-44b1-afeb-810064b954ad admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:28:33.608540 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-d8f2846c-a2ba-44b1-afeb-810064b954ad admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072574 Jul 02 03:28:33.609082 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Sat Jul 2 03:28:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:28:33.631814 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-5273ef73-15f1-455f-8e9b-906d46b8d225 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:28:33.635261 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG dbcounter [-] [103499] Writing DB stats nova_api:SELECT=14 {{(pid=103499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:28:33.641163 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-5273ef73-15f1-455f-8e9b-906d46b8d225 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012987 Jul 02 03:28:33.641684 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Sat Jul 2 03:28:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:28:33.656113 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-e1908cbc-43db-4b63-a5f2-c34a64469f62 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:28:33.663998 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-e1908cbc-43db-4b63-a5f2-c34a64469f62 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013979 Jul 02 03:28:33.664524 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Sat Jul 2 03:28:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:28:33.676240 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:28:33.684024 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011627 Jul 02 03:28:33.684539 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Sat Jul 2 03:28:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:28:33.696012 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-43c09b53-7eeb-4dc4-993a-8fc2123bde56 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:28:33.703711 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-43c09b53-7eeb-4dc4-993a-8fc2123bde56 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011267 Jul 02 03:28:33.704229 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Sat Jul 2 03:28:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:32:09.926924 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:09.928016 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jul 02 03:32:09.928442 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:32:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:32:10.066706 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_api:SELECT=6 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:10.214821 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-bb0c9756-85d1-41c3-9467-178ab65feb88 admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:10.216556 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:32:10.216556 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: warnings.warn(msg) Jul 02 03:32:10.218256 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-bb0c9756-85d1-41c3-9467-178ab65feb88 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:10.218885 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-bb0c9756-85d1-41c3-9467-178ab65feb88 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:10.220116 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-bb0c9756-85d1-41c3-9467-178ab65feb88 admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:10.220689 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-bb0c9756-85d1-41c3-9467-178ab65feb88 admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:10.256015 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-bb0c9756-85d1-41c3-9467-178ab65feb88 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.190726 Jul 02 03:32:10.256648 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Sat Jul 2 03:32:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:32:11.107649 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:11.108748 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 02 03:32:11.109170 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:32:11.313351 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-35db0616-381d-4064-9016-58d982bbe51f admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:11.314525 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:32:11.314525 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: warnings.warn(msg) Jul 02 03:32:11.315859 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-35db0616-381d-4064-9016-58d982bbe51f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:11.316295 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-35db0616-381d-4064-9016-58d982bbe51f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:11.317175 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-35db0616-381d-4064-9016-58d982bbe51f admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:11.317612 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-35db0616-381d-4064-9016-58d982bbe51f admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:11.337422 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-35db0616-381d-4064-9016-58d982bbe51f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.089447 Jul 02 03:32:11.337991 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Sat Jul 2 03:32:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:32:22.608709 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:22.609918 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001855 Jul 02 03:32:22.610468 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:32:22.764283 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_cell0:SELECT=4 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:22.765230 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_cell1:SELECT=4 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:22.765929 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG dbcounter [-] [103500] Writing DB stats nova_api:SELECT=8 {{(pid=103500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:22.819331 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-fbb86bdd-6fb5-47e1-9d49-28c0911148af admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:22.820492 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:32:22.820492 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: warnings.warn(msg) Jul 02 03:32:22.821665 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-fbb86bdd-6fb5-47e1-9d49-28c0911148af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:22.822089 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-fbb86bdd-6fb5-47e1-9d49-28c0911148af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:22.822854 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-fbb86bdd-6fb5-47e1-9d49-28c0911148af admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:22.823266 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-fbb86bdd-6fb5-47e1-9d49-28c0911148af admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:22.847671 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-fbb86bdd-6fb5-47e1-9d49-28c0911148af admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089869 Jul 02 03:32:22.848213 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Sat Jul 2 03:32:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:32:23.682619 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: DEBUG nova.api.openstack.wsgi [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] Calling method '>' {{(pid=103499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:23.683749 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: INFO nova.api.openstack.requestlog [None req-29ead40b-3ccb-4241-9b4d-a1558e3be825 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 02 03:32:23.684139 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: [pid: 103499|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Sat Jul 2 03:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:32:23.883880 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG nova.api.openstack.wsgi [None req-0f962b15-3c5d-4a8b-9574-725747824f7e admin admin] Calling method '>' {{(pid=103500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:32:23.885051 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:32:23.885051 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: warnings.warn(msg) Jul 02 03:32:23.886341 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-0f962b15-3c5d-4a8b-9574-725747824f7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:23.886729 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-0f962b15-3c5d-4a8b-9574-725747824f7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:23.887543 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-0f962b15-3c5d-4a8b-9574-725747824f7e admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:32:23.887982 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: DEBUG oslo_concurrency.lockutils [None req-0f962b15-3c5d-4a8b-9574-725747824f7e admin admin] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:32:23.909452 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: INFO nova.api.openstack.requestlog [None req-0f962b15-3c5d-4a8b-9574-725747824f7e admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083462 Jul 02 03:32:23.909992 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: [pid: 103500|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Sat Jul 2 03:32:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:33:20.663721 dv-cinder-846842-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 02 03:33:20.664334 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: Sat Jul 2 03:33:20 2022 - graceful shutdown triggered... Jul 02 03:33:20.664758 dv-cinder-846842-9-iscsi devstack@n-api.service[103500]: Gracefully killing worker 2 (pid: 103500)... Jul 02 03:33:20.665274 dv-cinder-846842-9-iscsi devstack@n-api.service[103499]: Gracefully killing worker 1 (pid: 103499)... Jul 02 03:33:21.665357 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: worker 1 buried after 1 seconds Jul 02 03:33:21.665357 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: worker 2 buried after 1 seconds Jul 02 03:33:21.665357 dv-cinder-846842-9-iscsi devstack@n-api.service[103498]: goodbye to uWSGI. Jul 02 03:33:21.668111 dv-cinder-846842-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 02 03:33:21.668983 dv-cinder-846842-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 02 03:33:21.673752 dv-cinder-846842-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 02 03:33:21.691082 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 02 03:33:21.695249 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 2 03:33:21 2022] *** Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: nodename: dv-cinder-846842-9-iscsi Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: machine: x86_64 Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: clock source: unix Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: pcre jit disabled Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: detected number of CPU cores: 4 Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: current working directory: / Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: detected binary path: /usr/bin/uwsgi-core Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: your processes number limit is 47680 Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: your memory page size is 4096 bytes Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: detected max file descriptor number: 2048 Jul 02 03:33:21.695620 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: lock engine: pthread robust mutexes Jul 02 03:33:21.697024 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: thunder lock: enabled Jul 02 03:33:21.697024 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 02 03:33:21.697024 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 02 03:33:21.740857 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: Python main interpreter initialized at 0x556672bb59c0 Jul 02 03:33:21.740857 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: python threads support enabled Jul 02 03:33:21.740857 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: your server socket listen backlog is limited to 100 connections Jul 02 03:33:21.740857 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: your mercy for graceful operations on workers is 90 seconds Jul 02 03:33:21.741361 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: mapped 403077 bytes (393 KB) for 2 cores Jul 02 03:33:21.741361 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: *** Operational MODE: preforking *** Jul 02 03:33:21.741587 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: *** uWSGI is running in multiple interpreter mode *** Jul 02 03:33:21.741587 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: spawned uWSGI master process (pid: 124499) Jul 02 03:33:21.741838 dv-cinder-846842-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 02 03:33:21.742447 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: spawned uWSGI worker 1 (pid: 124512, cores: 1) Jul 02 03:33:21.742799 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: spawned uWSGI worker 2 (pid: 124513, cores: 1) Jul 02 03:33:21.743203 dv-cinder-846842-9-iscsi devstack@n-api.service[124499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 02 03:33:22.397149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 03:33:22.398016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 03:33:23.608803 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:33:23.608803 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: from cryptography.utils import int_from_bytes Jul 02 03:33:23.609502 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:33:23.609502 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: from cryptography.utils import int_from_bytes Jul 02 03:33:23.617141 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:33:23.617141 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: from cryptography.utils import int_from_bytes Jul 02 03:33:23.617591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:33:23.617591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: from cryptography.utils import int_from_bytes Jul 02 03:33:26.005935 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 03:33:26.006638 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 03:33:26.006732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 03:33:26.007070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 03:33:26.007380 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 03:33:26.007769 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.008105 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.008428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.008753 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.009087 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.009402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.009704 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.010130 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.010678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.010947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.011270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.011629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-9-iscsi {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.011964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.012277 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.012596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.012920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.013232 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.013560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.013889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.014383 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.016166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.016491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.016822 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.017193 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.017512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.017815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.018158 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.018477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.018821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.019140 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.019617 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-9-iscsi {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.019943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.020516 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.020647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.021041 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.021353 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.021659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.021996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.022328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.022643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.023003 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.023334 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.023665 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.023992 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.024307 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.024634 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.024942 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.025268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.025673 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.025982 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.026246 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.026557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.026890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.027226 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.027594 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.027853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.028108 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.028432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.028758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.029079 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.029398 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.029707 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.030019 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.030334 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.030639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.030947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.031258 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.031620 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.031934 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.032268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.032579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.032908 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.033337 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.033586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.033896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.034255 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.034577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.034886 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.035209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.035580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.035884 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.036197 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.036508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.036831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.037170 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.037477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.037738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.038039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.038345 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.038670 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.038979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.039335 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.039629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.039940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.040248 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.040561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.040878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.041298 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.041865 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.042313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.042646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.042957 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.043270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.043652 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.043986 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.044287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.044603 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.044917 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.045234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.045571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.045879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.046532 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.047085 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.047424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.047736 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.048075 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.048390 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.048702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.049027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.049335 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.049648 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.049977 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.050295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.050604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.050913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.051221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.051559 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.051916 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.052169 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.052477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.052782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.053110 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.053439 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.053759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.054067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.054372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.054781 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.055070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.055417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.055766 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.056086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.056422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.056877 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.057224 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.057546 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.057867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.058198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.058514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.058838 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.059151 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.059502 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.059827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.060160 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.060483 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.060805 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.061126 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.061439 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.061760 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.062095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.062420 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.062735 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.063080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.063470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.063807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.064134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.064467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.064825 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.065256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.065423 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.065744 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.066097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.066410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.066743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.067051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.067489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.067814 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.068013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.068329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.068676 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.068994 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.069313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.069628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.069949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.070266 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.070580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.070894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.071204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.071540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.071847 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.072209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.072536 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.072846 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.073193 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.073510 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.073860 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.074246 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.074481 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.075227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.075502 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.075869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.076145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.079323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.080071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.080071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.080071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.080071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.080387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.080498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.080771 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.081091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.081443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.081781 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.082091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.082424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.082756 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.083077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.083425 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.083741 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.084050 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.084396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.084659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.084971 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.085356 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.085674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.085882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.086189 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.086730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.086889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.087118 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.087449 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.087873 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.088214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.088589 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.088967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.089260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.089606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.089933 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.090262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.090586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.090920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.091233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.091585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.091901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.092222 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.092548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.092862 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.093191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.093503 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.093833 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.094155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.094545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.094794 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.095115 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.095491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.095829 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.096147 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.096480 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.096972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.097126 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.097426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.097702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.098095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.098426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.098650 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.098953 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.099276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.099619 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.099947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.100261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.100585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.100894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.101212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.101550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.101899 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.102211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.102526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.102860 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.103174 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.103553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.104021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.104341 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.111269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.113410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.114571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.115801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.116871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.117946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.117946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.117946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.118426 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 03:33:26.118889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.119112 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 03:33:26.119308 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.119471 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 03:33:26.119659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.119815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 03:33:26.119976 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.120120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 03:33:26.120270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.120498 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.120644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.120644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.120644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.121678 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.121831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.121995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.122149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.122299 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.122457 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.122600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.122751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.122901 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.123043 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.123193 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.123446 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.123598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.123747 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.123900 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.124043 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.124193 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.124336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.124501 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.124664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.124944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-9-iscsi {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.125124 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.125283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.125426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.125578 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.125720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.125862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.126003 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.126154 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.126306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.126449 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.126616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.126759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.126908 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.127060 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.127211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.127211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.127523 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.127696 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.127850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.128000 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.128142 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.128312 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.129021 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.129262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.129420 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.129603 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.129764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.129914 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.130056 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.130255 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.130411 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.130556 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.130728 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.130890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.132278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.132449 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.132605 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.132757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.132757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.133056 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-9-iscsi {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.133200 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.133349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.133607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.133764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.133921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.134064 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.134214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.134367 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.134624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.134852 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.135033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.135184 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.135359 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.135517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.142004 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.142742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.142851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.142942 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.143037 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.143124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.143223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.143351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.143452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.143547 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.143654 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.143761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.144017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.144115 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.144190 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.144262 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.144339 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.144425 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.144499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.144499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.144499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.144701 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.144786 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.144880 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.144974 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.145059 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.145264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.145365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.145508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.145611 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.145698 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.145872 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.145964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.146063 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.146155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.146245 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.146337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.146422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.146513 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.146608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.146700 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.146791 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.146884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.146978 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.147071 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.147162 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.147253 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.147375 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.147475 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.147561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.147654 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.147747 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.147839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.147925 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.148100 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.148283 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148374 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.148457 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.148631 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148729 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.148821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.148996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.148996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.149312 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.149397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.149397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.149585 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.149684 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.149777 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.149862 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.149954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.150045 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.150143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.150238 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.150323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.150455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.150546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.150630 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.150713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.150836 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.150971 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.151078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.151165 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.151261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.151453 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.151541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.151625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.151709 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.151817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.151910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.152013 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.152105 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.152198 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.152302 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.152549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.152643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.152861 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.152954 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.153040 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.153125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.153218 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.153312 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.153411 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.153504 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.153591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.153681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.153778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.153870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.153870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.153870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.154118 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.154210 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.154297 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.154396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.154482 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.154573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.154665 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.154755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.154851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.154944 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.155029 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.155112 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.155200 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.155315 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.155415 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.155510 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.155603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.155687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.155772 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.155854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.155946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.156039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.156130 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.156215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.156305 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.156399 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.156497 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.156581 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.156672 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.156757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.156841 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.156933 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.157031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.157115 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.157206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.157299 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.157392 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.157476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.157566 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.157649 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.157827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.157935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.158139 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.158240 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.158450 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.158549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.158778 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.158884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.159091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.159190 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.159426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.159524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.159737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.159828 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.160044 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.160143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.160361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.160454 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.160669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.160762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.160986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.161111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.161300 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.161428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.161611 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.161742 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.161923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.162049 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.162237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.162363 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.162692 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.162796 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.162897 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.162978 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.163147 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.163302 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.163482 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.163619 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.163807 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.164040 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.164133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.164355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.164457 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.164668 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.164782 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.164988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.165116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.165303 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.165404 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:33:26.165613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.165725 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.165923 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.166036 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.166387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.166576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.166924 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.167017 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.167247 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.167373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.167660 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.167752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.167992 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.168093 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.168303 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.168410 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.168624 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.168758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.168960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.169061 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.169277 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.169384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.169598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.169691 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.169962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.170284 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.170613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.170871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.170993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.171585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.171683 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.171909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.172018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.172244 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.172339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.172568 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.172670 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.172894 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.172997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.173209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.173344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.173530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.173622 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.173851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.173971 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.174183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.174280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.174518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.174648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.174834 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.174936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.175153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.175249 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.175512 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.175602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.175832 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.175925 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.176149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.176239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.176468 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.176558 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.176800 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.176900 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.177128 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.177264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.177445 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.177593 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.177772 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.177909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.178092 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.178238 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.178409 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.178573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.178726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.178887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.179046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.179197 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.179389 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.179643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.179736 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.181219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.181329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.181406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.181489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.181656 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.181827 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.181940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182027 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182159 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182259 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182591 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182796 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182796 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.182973 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.183060 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.183147 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.183231 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.183399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.183516 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.183721 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.183820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.184035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.184136 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.184377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.184510 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.184687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.184807 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.185016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.185111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.185325 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.185434 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.185634 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.185736 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.185943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.186043 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.186254 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.186349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.186567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.186666 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.186883 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.186975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.187205 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.187402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.187551 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.187656 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.187866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.187967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.188190 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.188283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.188505 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.188604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.188820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.188912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.189150 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.189242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.189460 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.189560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.189775 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.189876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.190084 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.190175 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.190390 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.190483 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.190701 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.190811 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.191008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.191107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.191331 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.191441 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.191646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.191760 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.191953 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.192060 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.192259 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.192360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.192571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.192678 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.192876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.192969 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.193201 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.193294 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.193507 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.193601 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.193832 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.193949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.194144 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.194237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.194454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.194558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.194810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.194918 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.195070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.195179 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.195409 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.195519 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.195726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.195827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.196041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.196142 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.196353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.196453 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.196666 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.196758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.196975 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.197082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.197336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.197451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.197723 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.198044 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.198149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.198364 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.198459 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.198685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.198806 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.199007 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.199116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.199341 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.199452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.199665 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.199759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.199983 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.200087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.200294 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.200388 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.200613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.200705 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.200932 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.201039 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.201248 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.201342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.201624 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.201822 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.201945 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.202154 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.202255 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.202476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.202577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.202795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.202888 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.203112 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.203207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.203452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.203561 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.203772 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.203872 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.204088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.204182 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.204404 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.204504 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.204720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.204847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.205073 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.205163 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.205353 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.205455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.205679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.205783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.205989 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.206081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.206314 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.206406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.206637 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.206740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.206955 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.207048 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.207273 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.207384 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.207612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.207716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.207955 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.208062 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.208278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.208389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.208586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.208680 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.208902 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.209002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.209215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.209314 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.209529 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.209628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.209841 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.209933 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.210155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.210261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.210472 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.210564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.210785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.210883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.211095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.211195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.211436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.211533 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.211755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.211866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.212066 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.212173 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.212387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.212479 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.212724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.212815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.213066 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.213233 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.213382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.213696 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.213849 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.214013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.214185 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.214516 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.214606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.214836 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.214946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.215173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.215276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.215502 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.215596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.215805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.215907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.216121 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.216222 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.216438 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.216529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.216759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.216861 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.217068 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.217168 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.217374 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.217466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.217684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.217783 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.217993 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.218087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.218624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.218735 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.218735 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.218911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219023 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219116 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219643 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219866 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.219970 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.220195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.220409 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.220524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.220773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.220874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.221096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.221197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.221433 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.221525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.221756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.221851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.222071 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.222163 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.222384 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.222484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.222697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.222790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.223018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.223118 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.223352 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.223459 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.223675 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.223769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.223991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.224084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.224299 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.224388 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.224606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.224699 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.224925 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.225040 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.225246 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.225366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.225541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.225646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.225852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.225946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.226157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.226265 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.226476 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.226566 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.226784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.226870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.227088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.227191 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.227417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.227517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.227734 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.227826 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.228038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.228145 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.228347 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.228444 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.228707 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.228842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.229069 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.229387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.229582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.229693 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.229902 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.230004 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.230225 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.230318 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.230553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.230646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.230881 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.231146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.231239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.231521 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.231616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.231844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.231951 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.232169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.232261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.232479 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.232571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.232800 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.232905 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.233113 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.233212 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.233440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.233532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.233753 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.233855 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.234067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.234169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.234398 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.234490 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.234713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.234818 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.235054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.235265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.235406 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.235599 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.235702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.235923 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.236015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.236259 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.236361 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.236571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.236671 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.236881 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.236975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.237187 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.237293 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.237494 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.237586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.237804 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.237903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.238115 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.238206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.238422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.238520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.238733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.238826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.239041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.239134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.239375 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.239472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.239688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.239782 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.239996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.240102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.240305 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.240395 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.240612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.240717 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.240922 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.241013 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.241233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.241325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.241543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.241644 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.241856 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.241945 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.242171 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.242268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.242522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.242624 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.242844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.242936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.243164 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.243262 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.243500 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.243605 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.243818 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.243910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.244155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.244276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.244474 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.244788 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.244969 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.245172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.245285 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.245447 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.245599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.245747 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.245923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.246064 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.246251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.246372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.246553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.246870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.246961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.247180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.247283 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.247527 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.247629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.247838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.247938 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.248151 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.248251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.248474 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.248566 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.248787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.248891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.249099 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.249192 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.249417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.249519 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.249730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.249830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.250040 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.250132 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.250352 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.250454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.250662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.250762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.250985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.251093 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.251316 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.251424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.251631 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.251724 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.251940 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.252041 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.252250 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.252344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.252563 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.252662 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.252874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.252976 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.253179 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.253271 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.253487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.253581 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.253798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.253891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.254104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.254198 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.254410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.254513 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.254717 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.254847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.255024 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.255125 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.255354 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.255492 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.255662 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.255789 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256011 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256273 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256672 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.256974 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.257187 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.257288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.257495 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.257586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.257801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.257892 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.258107 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.258209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.258413 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.258506 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.258720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.258821 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.259027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.259129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.259358 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.259467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.259690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.259858 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.260113 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.260610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.260702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.260932 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.261030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.261252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.261358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.261561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.261661 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.261887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.261981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.262213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.262314 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.262536 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.262629 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.262849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.262951 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.263186 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.263286 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.263525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.263608 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.263840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.263922 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.264154 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.264260 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.264469 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.264561 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.264778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.264869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.265090 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.265194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.265445 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.265592 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.265726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.265859 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.266034 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.266129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.266343 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.266435 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.266671 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.266763 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.266989 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.267089 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.267339 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.267446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.267639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.267741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.267972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.268074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.268285 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.268378 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.268596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.268769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.268903 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.269001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.269215 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.269308 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.269526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.269636 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.269839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.269939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.270155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.270291 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.270470 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.270596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.270792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.270895 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.271101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.271183 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.271453 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.271560 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.271776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.271867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.272088 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.272180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.272406 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273300 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273395 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273583 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.273951 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.274035 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.274215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 03:33:26.274316 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.274551 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.274869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.275183 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.276179 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.276510 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.276835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.277151 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.277473 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.277796 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.278122 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.278489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.278803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.279232 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.279605 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.279947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.280265 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.280583 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.280919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.281241 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.281572 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.281884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.282195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.282507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.282837 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.283146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.283501 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.283928 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.284249 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.284564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.285018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.285334 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.285674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.285981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.286311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.286639 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.286952 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.287270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.287626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.287958 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.288289 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.288608 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.288930 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.289245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.289575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.289907 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.290224 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.290554 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.290976 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.291552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.291958 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.292407 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.292745 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.293063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.293381 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.293702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.294020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.294344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.294679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.294993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.295333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.295688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.296399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.296598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.296890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.297225 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.297536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.297868 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.298188 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.298520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.298850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.299189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.299517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.299835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.300148 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.300460 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.300774 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.301123 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.301439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.301770 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.302105 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.302438 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.302758 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.303102 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.303454 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.303775 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.304106 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.304438 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.304748 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.305058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.305372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.305681 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.305991 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.306339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.306779 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.307703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.308042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.308388 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.308791 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.309353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.309865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.310231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.310556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.310877 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.311196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.311576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.311894 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.312241 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.312575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.312908 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.313249 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.313570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.313903 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.314232 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.314566 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.314890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.315215 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.315569 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.315895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.316220 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.316536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.316863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.317191 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.317514 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.318093 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.318429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.318751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.319071 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.319564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.319740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.320063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.320382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.320700 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.321018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.321336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.321671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.322000 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.322362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.323176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.323558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.323886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.324231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.324562 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.324933 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.325262 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.325571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.325894 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.326216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.326537 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.326854 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.327173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.327557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.327835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.328153 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.328469 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.328787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.329105 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.329435 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.329776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.330097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.330419 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.330738 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.331059 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.331617 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.331936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.332276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.332611 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.332943 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.333268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.333595 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.333931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.334250 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.334561 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.334943 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.335347 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.335665 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.335996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.336321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.336632 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.336726 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO dbcounter [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Registered counter for database nova_api Jul 02 03:33:26.336961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.337280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.337824 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.338443 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.339130 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.339501 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.339868 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.340197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.340516 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.340851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.341175 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.341489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.341815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.342137 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.342451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.342764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.343081 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.343431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.343743 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.344169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.344495 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.344862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.345178 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.345489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.345800 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.346119 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.347197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.347197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.347197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.347521 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.347671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.348005 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.348344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.348754 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.349227 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.349557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.349949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.350442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.350783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.351098 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.351442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.351774 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.352467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.352910 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.353333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.356856 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.357240 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.357474 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_db.sqlalchemy.engines [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.357797 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.357904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.358326 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.358542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.358862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.359250 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.359765 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.360231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.360556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.360876 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.361195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.361517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.361834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.362155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.362472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.362776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.363098 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.363477 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.363811 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.364137 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.364307 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writer thread running {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.364469 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.364787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.365103 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.365407 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.365726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.366044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.366370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.366709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.367030 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.367368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.367901 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.368223 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.368548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.368878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.369276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.370218 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.370557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.370882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.371216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.371567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.371909 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.372262 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.372600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.372935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.373249 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.373562 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.373874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.374197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.374522 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.374838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.375150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.375487 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.375806 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.376117 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.376428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.376740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.377051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.377365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.377670 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.377981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.378297 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.378606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.378914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.379223 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.379563 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.379880 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.380185 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.380493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.380846 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.381146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.381490 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.381830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.382149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.382480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.382805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.383132 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.383472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.383807 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.384132 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.384459 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.384825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.385691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.386017 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.386340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.386662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.386983 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.387327 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.387721 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.388057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.388399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.388712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.389045 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.389372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.389700 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.390023 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.390342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.390679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.390997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.391370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.391663 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.391985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.392303 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.392626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.392952 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.393288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.393621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.393943 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.394276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.394612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.394967 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.395287 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.395659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.395996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.396319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.396638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.396949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:33:26.397198 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 03:33:26.420206 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.context [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b6b550-82d3-45fa-a0bc-b1fc6381a030(cell1) {{(pid=124512) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 03:33:26.424787 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:33:26.426417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:33:26.427249 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:33:26.429286 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:33:26.431351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO dbcounter [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Registered counter for database nova_cell0 Jul 02 03:33:26.435733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO dbcounter [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Registered counter for database nova_cell1 Jul 02 03:33:26.443241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_db.sqlalchemy.engines [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.445621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_db.sqlalchemy.engines [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.450340 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writer thread running {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.461781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO dbcounter [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Registered counter for database nova_api Jul 02 03:33:26.483553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_db.sqlalchemy.engines [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.490632 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writer thread running {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.556133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.context [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43b6b550-82d3-45fa-a0bc-b1fc6381a030(cell1) {{(pid=124513) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 03:33:26.560539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:33:26.562172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:33:26.563156 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:33:26.565192 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:33:26.567261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO dbcounter [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Registered counter for database nova_cell0 Jul 02 03:33:26.571463 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO dbcounter [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Registered counter for database nova_cell1 Jul 02 03:33:26.578921 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_db.sqlalchemy.engines [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.581912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_db.sqlalchemy.engines [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.587742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writer thread running {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.590787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writer thread running {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.591953 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writer thread running {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.602033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO dbcounter [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Registered counter for database nova_cell0 Jul 02 03:33:26.609017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_db.sqlalchemy.engines [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.613674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writer thread running {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.742918 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO dbcounter [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Registered counter for database nova_cell0 Jul 02 03:33:26.751914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_db.sqlalchemy.engines [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:33:26.756559 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writer thread running {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:33:26.934191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: WARNING keystonemiddleware.auth_token [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:33:26.942191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: WARNING keystonemiddleware.auth_token [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:33:27.074539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: WARNING keystonemiddleware.auth_token [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:33:27.082014 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: WARNING keystonemiddleware.auth_token [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:33:27.286292 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: WARNING keystonemiddleware.auth_token [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:33:27.293225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: WARNING keystonemiddleware.auth_token [None req-c629c07f-c89d-4602-86c5-4b418dca607f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:33:27.299337 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556672bb59c0 pid: 124512 (default app) Jul 02 03:33:27.424325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: WARNING keystonemiddleware.auth_token [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 03:33:27.430342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: WARNING keystonemiddleware.auth_token [None req-c7486b9f-3edc-4130-997b-8311b0667529 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 03:33:27.435951 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556672bb59c0 pid: 124513 (default app) Jul 02 03:34:19.813204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:19.815494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:19.817524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:19.819820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:20.661718 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-170237413", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:21.707319 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] validate_networks() for [('c1d7a687-b6ca-47c7-af08-d5e3055ff439', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:34:24.250187 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:24.251467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:24.252256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:24.254788 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:24.628979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:34:24.630676 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:34:24.631183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:34:24.631628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:34:24.632469 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:34:24.687166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:24.687700 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:24.688596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:24.693312 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:24.783180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:34:24.803003 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for user c941dc00e0584666aba13263b8c1fcb8 and project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:34:24.834997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:34:24.843323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:34:25.112385 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1472cc13-4f53-4af8-a73d-81e221250e84 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.329900 Jul 02 03:34:25.113100 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:34:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 5332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:34:25.124549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-974a5b02-3018-43ce-bc5e-1c17db25c7ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:25.125065 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-974a5b02-3018-43ce-bc5e-1c17db25c7ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:25.357385 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1173998773", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "networks": [{"uuid": "841d9f2c-8f95-4b65-a9a0-b6cfcdd1bb5e"}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:25.555182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-974a5b02-3018-43ce-bc5e-1c17db25c7ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:25.622690 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-974a5b02-3018-43ce-bc5e-1c17db25c7ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1221 microversion: 2.1 time: 0.502746 Jul 02 03:34:25.632229 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:25 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1221 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:26.053840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1474575840", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:26.201260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] validate_networks() for [('c1d7a687-b6ca-47c7-af08-d5e3055ff439', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:34:27.120268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] validate_networks() for [('841d9f2c-8f95-4b65-a9a0-b6cfcdd1bb5e', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:34:27.987702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:34:27.988552 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:34:27.989461 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:34:27.989890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:34:27.990316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:34:28.021177 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:28.021597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:28.022428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:28.053085 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:28.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:34:28.131218 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for user c941dc00e0584666aba13263b8c1fcb8 and project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:34:28.182470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:34:28.188934 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:34:28.265234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-722be682-b9cb-4a96-ba41-d5e48d8c9381 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.217700 Jul 02 03:34:28.273060 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 3/3] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:34:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 03:34:28.561962 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f326e2f0-3ab9-4d8b-b655-39e950664586 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: .version_select at 0x7f2e9c3cb670>, body: {"keypair": {"name": "tempest-keypair-360202105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFulQQUaVhzTsKo92N1RnMQYpKyuOhyHwCLm0gUh8NP68SEEppIablzX5WrV8ePzYnfGLO0xTquMmpNZPThT6RBpoMl9hCHp95UOXobkljI1/NfVb3HLMN+w9UjdGrYfw=="}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:28.619145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-f326e2f0-3ab9-4d8b-b655-39e950664586 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:34:28.627649 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-f326e2f0-3ab9-4d8b-b655-39e950664586 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:34:28.736891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f326e2f0-3ab9-4d8b-b655-39e950664586 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.462095 Jul 02 03:34:28.743072 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 4/4] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:34:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:34:28.743072 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-57217cee-f527-4880-a355-7758c2f073e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:28.743385 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-57217cee-f527-4880-a355-7758c2f073e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:28.929616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-57217cee-f527-4880-a355-7758c2f073e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:28.945684 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-57217cee-f527-4880-a355-7758c2f073e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1222 microversion: 2.1 time: 0.206557 Jul 02 03:34:28.952649 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:28 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:29.253583 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:34:29.254106 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:34:29.254449 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:34:29.254850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:34:29.255258 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:34:29.293548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:29.294015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:29.295255 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:29.295255 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:29.406858 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Getting quotas for project dedc7a5a95d14f60b1a73198c8b5309b. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:34:29.452535 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Getting quotas for user 9028859afbab40df9fc4e5ea6d876931 and project dedc7a5a95d14f60b1a73198c8b5309b. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:34:29.479718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:34:29.483212 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:34:29.509633 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-332d0395-f8d7-4c04-aebb-20829978882b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'create', calling method: .version_select at 0x7f2e9c3e1af0>, body: {"keypair": {"name": "tempest-keypair-500178063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVcD+ZWu9h+lBqCYWxnciQnNCOpRzlrDtKTy3f9ynjyGJ88zSMtyrC1FyI4qlLjB9dWcj4RH3rxxl5aDeIg5QpYZDceORTcjOpEhXb8m+vD7oGyJng4dg6jQDsmPN7odQ=="}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:29.541815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-332d0395-f8d7-4c04-aebb-20829978882b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:34:29.552630 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-332d0395-f8d7-4c04-aebb-20829978882b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for user 112d731047a64efc8e9143c4d471a7d6 and project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:34:29.609299 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-332d0395-f8d7-4c04-aebb-20829978882b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.360771 Jul 02 03:34:29.610022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 6/6] 10.222.0.42 () {62 vars in 1199 bytes} [Sat Jul 2 03:34:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 364 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 02 03:34:29.658577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0c5edc6b-c4de-4bc7-adc2-f03010966830 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.416323 Jul 02 03:34:29.661904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 1/7] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 5421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:34:29.673282 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f7998825-d3f1-4e1d-bf89-7f8cb54d09bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:29.673902 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f7998825-d3f1-4e1d-bf89-7f8cb54d09bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:29.954020 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f7998825-d3f1-4e1d-bf89-7f8cb54d09bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:29.968342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:29.969028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:29.983802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f7998825-d3f1-4e1d-bf89-7f8cb54d09bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1215 microversion: 2.1 time: 0.306713 Jul 02 03:34:29.985009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 7/8] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:29 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:30.000391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:30.007068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:30.008650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:30.009979 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:30.484465 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:30.527713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c0d5d8eb-0baf-48ff-bd8c-52ef7f2213ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1226 microversion: 2.1 time: 0.563941 Jul 02 03:34:30.530979 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 2/9] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:29 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1226 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:31.011206 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:31.015097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:31.111971 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:31.112768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:31.113396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:31.113839 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:31.551964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:31.552577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:31.565001 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:31.570475 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:31.586584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:31.587158 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:31.637103 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:31.656370 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-beae7b10-78ef-4017-90c7-5a2d123f3a1c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1219 microversion: 2.1 time: 0.657408 Jul 02 03:34:31.656966 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 8/10] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:30 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1219 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:31.841518 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:31.854536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fffcfa8c-54b6-4095-82ed-356c8a09c291 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1218 microversion: 2.1 time: 0.311270 Jul 02 03:34:31.870879 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 3/11] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:31 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1218 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:32.674389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:32.675013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:32.689975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:32.690857 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:32.693974 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:32.694461 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:32.878990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:32.888433 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:32.915620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:32.926684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:32.929859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:32.933997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:33.274741 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:33.283052 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e249e0e9-5f1f-4c6c-9b28-1ff5f60ec6b3 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1267 microversion: 2.1 time: 0.612819 Jul 02 03:34:33.287849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 9/12] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:32 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1267 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:33.537866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:33.566345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ab372c99-f909-47dc-a145-481aaaf89f92 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1274 microversion: 2.1 time: 0.672071 Jul 02 03:34:33.571006 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 4/13] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:32 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1274 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:34.301446 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:34.301977 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:34.321160 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:34.321381 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:34.322170 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:34.322632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:34.590985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:34.591668 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:34.601168 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:34.604333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:34.605228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:34.605675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:34.765530 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:34.774001 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fbc1a67e-c8f4-4249-ad90-2dac6905d6d3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1280 microversion: 2.1 time: 0.186996 Jul 02 03:34:34.783434 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 5/14] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:34 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:35.172077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:35.186302 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-aa183432-d56f-4ffc-9c65-df92cb88e03d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1273 microversion: 2.1 time: 0.888723 Jul 02 03:34:35.190843 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 10/15] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:34 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1273 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:35.791857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:35.792715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:35.801600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:35.802049 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:35.813668 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:35.814130 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:36.218374 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:36.227807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:36.239442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:36.244577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:36.245710 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:36.246598 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:36.646752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:36.660919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0598b3c1-e4da-4470-b441-38a9fccbb5dd tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1273 microversion: 2.1 time: 0.446922 Jul 02 03:34:36.668029 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 11/16] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:36 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1273 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:36.670152 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:36.686209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e7988adf-2c5d-4e0e-b84f-02f53c0bfb9a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1280 microversion: 2.1 time: 0.898338 Jul 02 03:34:36.697839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 6/17] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:35 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1280 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:37.244919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192043438", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "389311ee-b4f4-4d7f-89a6-51f9bda5ef70"}], "security_groups": [{"name": "tempest-securitygroup--654805543"}], "key_name": "tempest-keypair-360202105", "user_data": "}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:37.687657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:37.689112 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:37.714542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:37.715047 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:37.718917 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:37.722659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:38.100027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=4 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:38.131125 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:38.140766 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-984add78-5aba-434d-a973-9d9e30224e36 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1273 microversion: 2.1 time: 0.458175 Jul 02 03:34:38.148125 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 7/18] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:37 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1273 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:38.154946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:38.159885 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:38.189891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:38.190698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:38.192315 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:38.198274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:38.339867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] validate_networks() for [('389311ee-b4f4-4d7f-89a6-51f9bda5ef70', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:34:38.553447 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:38.563776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-72a3d1c7-97f3-4612-a9be-56e8feb7f194 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1280 microversion: 2.1 time: 0.414047 Jul 02 03:34:38.604394 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 8/19] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:38 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1280 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:39.173627 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:39.176181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:39.191735 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:39.195330 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:39.196786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:39.197676 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:39.349278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:39.471513 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:39.959457 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=26 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:40.377600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:40.412921 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-83386cc2-79d8-4c13-a925-9d32dc3512bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1273 microversion: 2.1 time: 1.250443 Jul 02 03:34:40.413417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 9/20] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:39 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1273 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:40.421402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:40.422029 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:40.445785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:40.446318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:40.447346 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:40.449349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:41.105683 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:34:41.106154 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:34:41.106657 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:34:41.106736 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:34:41.107184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:34:41.154372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:41.160398 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:41.165932 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:41.172936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:41.216815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:41.233652 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c0e0d483-d0d1-49d5-8608-297d0dd05219 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1280 microversion: 2.1 time: 0.816484 Jul 02 03:34:41.235554 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 10/21] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:40 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1280 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:41.245166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:34:41.261722 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:34:41.332862 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:34:41.361202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:34:41.439761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:41.441838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:41.453451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:41.454214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:41.458042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:41.458772 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:41.600498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-69d518dc-36da-4954-8d57-a6bbb5d51262 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.367738 Jul 02 03:34:41.601350 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 12/22] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:34:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 4377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:34:41.630611 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7973dd7c-0aed-4c96-9cfb-a1565a8d823b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:41.631515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7973dd7c-0aed-4c96-9cfb-a1565a8d823b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:42.146668 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:42.155389 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e322306a-507d-4398-bc77-8fb72a42a5dc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1273 microversion: 2.1 time: 0.722937 Jul 02 03:34:42.158561 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:41 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1273 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:42.182830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7973dd7c-0aed-4c96-9cfb-a1565a8d823b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:42.195582 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7973dd7c-0aed-4c96-9cfb-a1565a8d823b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1241 microversion: 2.1 time: 0.586493 Jul 02 03:34:42.198084 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:41 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1241 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:42.256677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:42.258005 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:42.279046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:42.281162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:42.282835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:42.291544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:43.176469 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:43.178331 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:43.195813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:43.199826 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:43.204455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:43.205298 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:43.206016 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:43.532896 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:43.543774 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0e3fc7c7-3c8c-41d6-9116-70a380f87630 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 1.293206 Jul 02 03:34:43.544357 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:42 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:43.563890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:43.564577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:43.572651 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:43.573453 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:43.574452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:43.575053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:43.921291 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:43.936652 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8e9c3f3a-40b9-434e-8c60-8746d8fd19a0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1293 microversion: 2.1 time: 0.380677 Jul 02 03:34:43.941238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 13/26] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:43 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1293 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:43.964352 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-556042047", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc0b5a80-e232-44f7-a253-08cca2946b9f"}], "security_groups": [{"name": "tempest-securitygroup--1368147828"}], "key_name": "tempest-keypair-500178063", "user_data": "}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:44.124682 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:44.147691 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-20d3ec1c-41c8-4076-af11-f390af544b5c tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.975878 Jul 02 03:34:44.164971 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:43 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:44.563838 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:44.567598 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:44.577073 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:44.577536 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:44.605653 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:44.610864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:45.208664 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] validate_networks() for [('dc0b5a80-e232-44f7-a253-08cca2946b9f', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:34:46.471504 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:46.481346 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6f1280ad-5c4c-4ba6-98f0-6a4806112576 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 1.923684 Jul 02 03:34:46.484288 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:44 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:46.500888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:46.502445 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:46.510667 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:46.517577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:46.525922 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:46.530581 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:46.836272 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:46.845606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0d4f1707-c837-471d-83e3-1ffdb610925b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1299 microversion: 2.1 time: 0.359963 Jul 02 03:34:46.854098 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:46 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1299 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:47.308329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-e8186f3a-8323-4eba-b5e6-762477744ee9 req-c52f7c39-8a74-4248-b467-69a2fdfc63ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dee71eb-cb9f-458e-96b2-4f6db8156153", "tag": "1d5c4d80-4bf3-4936-9cbd-a7174cf1642f"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:47.326839 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-e8186f3a-8323-4eba-b5e6-762477744ee9 req-c52f7c39-8a74-4248-b467-69a2fdfc63ee service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:47.328090 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-e8186f3a-8323-4eba-b5e6-762477744ee9 req-c52f7c39-8a74-4248-b467-69a2fdfc63ee service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:47.410250 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-e8186f3a-8323-4eba-b5e6-762477744ee9 req-c52f7c39-8a74-4248-b467-69a2fdfc63ee service nova] Creating event network-changed:1d5c4d80-4bf3-4936-9cbd-a7174cf1642f for instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 on hv-cinder-84684 Jul 02 03:34:47.412544 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-e8186f3a-8323-4eba-b5e6-762477744ee9 req-c52f7c39-8a74-4248-b467-69a2fdfc63ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=124512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 03:34:47.416850 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb8e46f6-3ebc-4c42-900f-db7cb66056ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:47.417987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb8e46f6-3ebc-4c42-900f-db7cb66056ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:47.422169 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb8e46f6-3ebc-4c42-900f-db7cb66056ef None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:47.425017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb8e46f6-3ebc-4c42-900f-db7cb66056ef None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:47.460610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.compute.rpcapi [None req-eb8e46f6-3ebc-4c42-900f-db7cb66056ef None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 02 03:34:47.462698 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb8e46f6-3ebc-4c42-900f-db7cb66056ef None None] Releasing lock "compute-rpcapi-router" {{(pid=124512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 03:34:47.507908 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-eb8e46f6-3ebc-4c42-900f-db7cb66056ef None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.651773 Jul 02 03:34:47.508845 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 17/30] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:34:47.514698 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:47.520568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:47.543031 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:47.551776 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:47.553142 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:47.557079 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:48.594379 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:34:48.596574 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:34:48.597726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:34:48.598602 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:34:48.599232 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:34:48.605733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:48.613404 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fa810b58-93db-4105-94e1-1b222e6a2d91 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 1.103094 Jul 02 03:34:48.619756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:48.621051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:48.621881 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:48.622852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 18/31] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:47 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:48.623377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:48.627987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:48.628602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:48.639412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:48.639871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:48.640660 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:48.641099 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:48.668197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:34:48.673962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for user 112d731047a64efc8e9143c4d471a7d6 and project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:34:48.693528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:34:48.697267 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:34:48.763134 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-343f789a-b8d5-4fdf-b513-a8ea27c05bd2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.818804 Jul 02 03:34:48.764084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 14/32] 10.222.0.42 () {62 vars in 1187 bytes} [Sat Jul 2 03:34:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 4822 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 03:34:48.768711 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:48.769501 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:48.776169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:48.776855 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:48.777785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:48.778365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:49.290321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:49.302794 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6ce9e879-4332-4640-96e3-a2d594d3fd8a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.677221 Jul 02 03:34:49.304199 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 19/33] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:48 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:49.313234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:49.313234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:49.334352 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:49.336562 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:49.337806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:49.339458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:49.384086 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:49.403370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9c8bf513-1a34-480d-b716-95db794f29f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.638017 Jul 02 03:34:49.408571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:48 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:49.459032 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:49.470669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:49.473580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:49.476762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5d197590-6fb4-4dac-af79-2a94277c2093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1284 microversion: 2.20 time: 0.168950 Jul 02 03:34:49.490487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 20/35] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:49 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:49.630055 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:49.630667 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:49.639986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:49.640448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:49.641228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:49.641670 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:49.851121 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-fbd59a32-ebaf-47ed-97be-023da4fe9324 req-be16549f-fe93-44a0-a75d-84f5932b35c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6102b173-1c0f-441b-8d00-2cd53314544d", "tag": "e02d1bfd-a033-4aa9-9067-1cfc9301fed1"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:49.861261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-fbd59a32-ebaf-47ed-97be-023da4fe9324 req-be16549f-fe93-44a0-a75d-84f5932b35c1 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:49.861554 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-fbd59a32-ebaf-47ed-97be-023da4fe9324 req-be16549f-fe93-44a0-a75d-84f5932b35c1 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:49.874123 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-fbd59a32-ebaf-47ed-97be-023da4fe9324 req-be16549f-fe93-44a0-a75d-84f5932b35c1 service nova] Creating event network-changed:e02d1bfd-a033-4aa9-9067-1cfc9301fed1 for instance 6102b173-1c0f-441b-8d00-2cd53314544d on hv-cinder-84684 Jul 02 03:34:49.880267 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-fbd59a32-ebaf-47ed-97be-023da4fe9324 req-be16549f-fe93-44a0-a75d-84f5932b35c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231638 Jul 02 03:34:49.881993 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 21/36] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:34:49.892505 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:49.901088 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-edf26395-3dc5-4913-bd3a-c4b7e08273a1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.274920 Jul 02 03:34:49.910643 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 16/37] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:49 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:50.326746 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:50.327832 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:50.335894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.336370 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:50.337446 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.338164 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:50.345077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=73 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:50.426984 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:50.427623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:50.435115 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.435895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:50.436872 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.437771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:50.699944 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:50.709414 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ca926758-1678-4018-930e-280e47265484 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.392343 Jul 02 03:34:50.710256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 22/38] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:50 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:50.729551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:50.733683 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:50.741819 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.742500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:50.744499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.745149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:50.777327 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:50.788727 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0e4aca14-00c5-4577-8098-59ed3ab1e92d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.366895 Jul 02 03:34:50.799831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 17/39] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:50 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:50.825534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:50.834214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:50.838438 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:50.840944 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8201018b-730a-4e85-96af-e7075c644d2b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1284 microversion: 2.20 time: 0.117007 Jul 02 03:34:50.842332 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 23/40] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:50 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:50.918346 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:50.918981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:50.927424 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.927935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:50.928937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:50.929427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:51.142865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:51.151759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:51.161814 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3dff3ce1-e07a-4d51-9d72-604ab484f440 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.248026 Jul 02 03:34:51.163524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 18/41] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:50 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:51.733851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:51.734735 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:51.744069 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:51.744500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:51.745285 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:51.745721 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:51.809646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:51.811382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:51.844165 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:51.845006 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:51.845819 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:51.846753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:51.947747 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:51.958806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1b0ba4f4-7f1b-4825-94fa-edab89f1da13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.230492 Jul 02 03:34:51.960250 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 24/42] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:51 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:51.968149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:51.969113 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:51.977129 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:51.977958 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:51.978752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:51.979253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:52.140837 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:52.156577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9f25f178-8f4b-4bb6-8a7c-5d9fc631d21d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.347589 Jul 02 03:34:52.157388 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:51 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:52.166543 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-6f8b0eac-2e39-486f-b47f-ac8ce9b90850 req-f0fcddbb-dfbd-4429-8491-bd915830ea68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaef5120-b756-40f2-b615-a9786eb21a9c", "tag": "cb39fa4c-e4cc-46f8-8399-e7c6977c9420"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:52.190303 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:52.191672 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-6f8b0eac-2e39-486f-b47f-ac8ce9b90850 req-f0fcddbb-dfbd-4429-8491-bd915830ea68 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:52.192329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-6f8b0eac-2e39-486f-b47f-ac8ce9b90850 req-f0fcddbb-dfbd-4429-8491-bd915830ea68 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:52.197435 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=8 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:52.218378 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:52.220669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:52.221917 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-22ac1649-8fa3-4f41-a48f-c767d37f70fb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1284 microversion: 2.20 time: 0.259142 Jul 02 03:34:52.223524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 25/44] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:51 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:52.224585 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-6f8b0eac-2e39-486f-b47f-ac8ce9b90850 req-f0fcddbb-dfbd-4429-8491-bd915830ea68 service nova] Creating event network-changed:cb39fa4c-e4cc-46f8-8399-e7c6977c9420 for instance aaef5120-b756-40f2-b615-a9786eb21a9c on hv-cinder-84684 Jul 02 03:34:52.225582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-6f8b0eac-2e39-486f-b47f-ac8ce9b90850 req-f0fcddbb-dfbd-4429-8491-bd915830ea68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 03:34:52.227414 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d13b0c2b-fa80-4174-99e1-8712a7be0e03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:52.228067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d13b0c2b-fa80-4174-99e1-8712a7be0e03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:52.229033 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d13b0c2b-fa80-4174-99e1-8712a7be0e03 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:52.229642 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d13b0c2b-fa80-4174-99e1-8712a7be0e03 None None] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:52.230793 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:52.231531 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:52.241617 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.compute.rpcapi [None req-d13b0c2b-fa80-4174-99e1-8712a7be0e03 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 02 03:34:52.242963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d13b0c2b-fa80-4174-99e1-8712a7be0e03 None None] Releasing lock "compute-rpcapi-router" {{(pid=124513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 03:34:52.247101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:52.248389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:52.249448 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:52.251615 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:52.281427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d13b0c2b-fa80-4174-99e1-8712a7be0e03 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122606 Jul 02 03:34:52.282438 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 20/45] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:34:52.497515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:52.506633 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-02a78cc0-2d70-46f5-b620-e7584226deba tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.280727 Jul 02 03:34:52.517708 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 26/46] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:52 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:52.979731 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:52.981696 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:52.997257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:52.998790 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.000271 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:53.000714 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.175893 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:53.176692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:53.190268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:53.193035 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.193867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:53.195969 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.663967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:53.667787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:53.671926 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-66e0af48-c54c-4b22-a85a-5cc07f9fa295 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.501482 Jul 02 03:34:53.672507 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 27/47] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:53 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:53.685724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8cb50148-21b9-4363-ab71-19ac88342008 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.712906 Jul 02 03:34:53.688110 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:52 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:53.688422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:53.689051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:53.693440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:53.694041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:53.700751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:53.701192 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.702006 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:53.702333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:53.702464 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.702786 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.704088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:53.704088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:53.890282 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:53.905090 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:53.906930 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:53.908218 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5b549403-edd8-489d-97d8-2963bc0245b1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1332 microversion: 2.20 time: 0.234672 Jul 02 03:34:53.910037 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 28/49] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:53 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:53.984030 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:53.995449 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3db716e0-d514-4a90-afa6-97d13fbe5398 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.306180 Jul 02 03:34:54.003592 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 22/50] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:53 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:54.044798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-48994dd6-d9fc-48dc-9776-00bed4f5f5b6 req-2370e2ac-44e7-4665-8a35-867cbd6e40a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e880e075-40f8-4727-b142-83ae3e2c6d03", "tag": "54a638db-254c-4005-b3f3-014e45f9ff9e"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:34:54.059946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-48994dd6-d9fc-48dc-9776-00bed4f5f5b6 req-2370e2ac-44e7-4665-8a35-867cbd6e40a7 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:54.060389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-48994dd6-d9fc-48dc-9776-00bed4f5f5b6 req-2370e2ac-44e7-4665-8a35-867cbd6e40a7 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:54.080436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-48994dd6-d9fc-48dc-9776-00bed4f5f5b6 req-2370e2ac-44e7-4665-8a35-867cbd6e40a7 service nova] Creating event network-changed:54a638db-254c-4005-b3f3-014e45f9ff9e for instance e880e075-40f8-4727-b142-83ae3e2c6d03 on hv-cinder-84684 Jul 02 03:34:54.096332 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-48994dd6-d9fc-48dc-9776-00bed4f5f5b6 req-2370e2ac-44e7-4665-8a35-867cbd6e40a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061922 Jul 02 03:34:54.097261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 29/51] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:34:54.689399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:54.690009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:54.692055 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:54.700628 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:54.701194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:54.702265 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:54.702906 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:54.703365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:54.704551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:54.710970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:54.711653 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:54.712422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:54.712842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:54.908303 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:54.912912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:54.919038 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-28de81ea-b2a8-4159-9036-0ec64d3df2f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.233414 Jul 02 03:34:54.919756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 23/52] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:54 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:54.922754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fcac15d8-f766-4eb7-a4f1-64da5d51ae22 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.223557 Jul 02 03:34:54.923574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 30/53] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:54 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:54.934730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:54.935388 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:54.941719 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:54.942644 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:54.942915 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:54.943568 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:55.011639 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:55.019913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:55.020360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:55.020482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:55.021911 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:55.023790 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-133a46af-97b1-4e63-9c41-1a17ac484fe3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1332 microversion: 2.20 time: 0.093298 Jul 02 03:34:55.025278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 24/54] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:54 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:55.028770 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:55.029343 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:55.030080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:55.030746 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:55.173480 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:55.181313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cba11fd2-ffa7-44c2-b800-800db20642a5 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.165788 Jul 02 03:34:55.181826 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 31/55] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:55 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:34:55.936330 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:55.936935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:55.941844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:55.943350 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:55.944049 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:55.944150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:55.944664 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:55.945678 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:55.951338 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:55.951901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:55.952804 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:55.953361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:56.165503 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:56.171696 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:56.175369 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2f50a20e-1429-428b-9c64-fb21249c7310 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.237011 Jul 02 03:34:56.180749 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d23178ac-7c0e-40cc-a927-3e28e7eade45 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.248204 Jul 02 03:34:56.181539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 25/56] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:55 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:56.185137 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 32/57] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:55 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:56.186761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:56.187691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:56.195996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:56.196622 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:56.197924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:56.198496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:56.199590 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:56.200440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:56.207655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:56.208203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:56.209070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:56.209602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:56.272207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:56.280353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:56.281847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:56.282938 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9ecbf6df-bd0f-4bbd-8d10-3ab6ee04c8b3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1332 microversion: 2.20 time: 0.100174 Jul 02 03:34:56.283671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 26/58] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:56 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:56.359663 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:56.367448 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-544d1905-acfd-4e0d-98bb-633998f08861 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.173212 Jul 02 03:34:56.368017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 33/59] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:56 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:57.192045 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:57.192806 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:57.197931 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:57.198664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:57.200415 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.201650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.201650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.202041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.204809 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.205257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.206004 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.206625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.407979 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:57.415582 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:57.422325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-75da1aa4-0360-4803-917a-64cf8fdeeebd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.234031 Jul 02 03:34:57.424253 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 27/60] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:57 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:57.425231 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0e70a754-3548-40f6-9ed9-222482609777 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.231235 Jul 02 03:34:57.430029 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:57.430810 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:57.436051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 34/61] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:57 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:57.437227 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.437849 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.438621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.439335 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.441937 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:57.442758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:57.450981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=4 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:57.452936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.453379 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.454183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:57.454612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:57.513867 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:57.528366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:57.529891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:57.531015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-72942527-bfc2-4e2c-a11d-ec67a88a92b0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1332 microversion: 2.20 time: 0.105686 Jul 02 03:34:57.531623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 28/62] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:57 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:57.611963 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:57.620020 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-64772080-f470-436b-957b-0c837058457f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.182350 Jul 02 03:34:57.620753 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 35/63] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:57 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:58.440035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:58.441814 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:58.442226 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:58.442669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:58.448355 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.448804 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.449164 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.449342 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.450062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.450172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.450618 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.450732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.672790 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:58.683779 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:58.688564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:58.695163 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-173cb1f4-2c77-4205-b831-9e4d94342a2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.257134 Jul 02 03:34:58.695757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 36/64] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:58 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:58.711047 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:58.711552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9e5a9912-d6f5-4099-8525-4fa7d92335c7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.275182 Jul 02 03:34:58.712007 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:58.718953 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.719623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.720574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.721162 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.725922 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 29/65] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:58 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:58.738101 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:58.739179 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:58.749727 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.750606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.752087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:58.753176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:58.800366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:58.811695 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:58.817680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:58.820030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-438ab704-0fed-46f7-be0f-b9e76c7ee988 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1332 microversion: 2.20 time: 0.113467 Jul 02 03:34:58.820875 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 37/66] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:58 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:34:59.110863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:59.118881 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b0286bb3-864d-417c-bdd2-3ef1e0dc67f1 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.391623 Jul 02 03:34:59.119482 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 30/67] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:58 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:59.713952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:59.714563 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:59.720988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:59.721113 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:59.721808 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:59.722246 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:59.738744 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:59.740001 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:34:59.750719 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:59.751794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:59.753136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:34:59.753707 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:34:59.964897 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:34:59.973713 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d6d3e510-9f8a-4447-9857-bddf5ea4b31b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.263228 Jul 02 03:34:59.974486 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 38/68] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:59 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:34:59.980393 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:34:59.981605 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:00.001821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:00.001821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:00.001821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:00.001821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:00.002434 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:00.011691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-256cfc88-827e-4b53-9029-31c417ef1b13 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.277030 Jul 02 03:35:00.015582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 31/69] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:34:59 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:00.032002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:00.093461 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:00.107433 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:00.109469 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:00.110796 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-15b07731-548a-4b70-bc74-ebde9eb02cba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1332 microversion: 2.20 time: 0.135120 Jul 02 03:35:00.111532 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 39/70] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:34:59 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:00.138761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:00.140122 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:00.150684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:00.151187 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:00.152160 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:00.152754 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:00.531419 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:00.541214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1843a491-3f07-411f-9ccb-1fa6628ab7c8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.408549 Jul 02 03:35:00.542859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 32/71] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:00 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:00.992154 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:00.993339 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:01.002066 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.002968 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.003911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.004491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.030809 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:01.031460 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:01.040685 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.041328 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.044328 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.051804 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.414268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:01.419799 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:01.427841 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b7cb8f45-d9dd-41ed-9399-7e94bf447f81 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.441003 Jul 02 03:35:01.428425 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 40/72] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:00 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:01.437172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:01.437172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:01.439736 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e729a1f4-6684-4316-aec7-d238c256b50c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.402225 Jul 02 03:35:01.441014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.441616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.442514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.443073 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.449799 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 33/73] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:01 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:01.559627 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:01.560968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:01.567394 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:01.572968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.575759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.577898 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:01.580116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:01.581213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:01.586362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:01.589959 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6453be08-e485-47fb-b32f-08253100ca35 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1338 microversion: 2.20 time: 0.160356 Jul 02 03:35:01.593491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 41/74] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:01 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:01.783414 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:01.796271 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4ada9fe7-b9a9-4943-a9a2-774fd244df0e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.239931 Jul 02 03:35:01.798303 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 34/75] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:01 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:02.445537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:02.446100 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:02.453197 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.453628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:02.454402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.454835 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:02.457762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:02.458376 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:02.461336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=4 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:02.467239 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.467750 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:02.468545 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.468986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:02.669590 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:02.678318 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fe526698-5e46-4009-a9cb-2651eaf150b0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.237033 Jul 02 03:35:02.682401 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:02.686319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:02.690704 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 42/76] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:02 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:02.692830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-da4ad617-3e06-4383-8dc6-7f459238e5ca tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.239145 Jul 02 03:35:02.696440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 35/77] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:02 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:02.704491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:02.705358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:02.714495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.714973 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:02.715851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.716988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:02.792215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:02.802283 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:02.804723 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:02.806474 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c6948e32-95d2-4abd-a530-16fd28025a5a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1338 microversion: 2.20 time: 0.114092 Jul 02 03:35:02.807576 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 43/78] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:02 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1338 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:02.815401 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:02.816584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:02.823884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.824524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:02.825582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:02.826395 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:03.041300 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:03.049333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-236d3aaf-6eca-49bf-bd0c-a2e35cdc18bb tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.238490 Jul 02 03:35:03.049908 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 36/79] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:02 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:03.698027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:03.698638 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:03.705152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:03.705518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:03.706294 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:03.706731 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:03.712591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:03.713204 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:03.719406 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:03.719860 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:03.720619 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:03.721269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:03.915210 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:03.924876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3055c4f1-c1d5-43d2-85de-0bfecc8744b6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.230880 Jul 02 03:35:03.925257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:03.925975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 44/80] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:03 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:03.933689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-83711b61-ffe0-4024-b28a-fe20678a54e5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.225181 Jul 02 03:35:03.934250 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 37/81] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:03 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:03.935838 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:03.936461 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:03.944227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:03.945710 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:03.946929 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:03.947453 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:04.027485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:04.035768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:04.037473 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:04.039492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-02e66377-96b8-4804-8438-d140943d00a7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1338 microversion: 2.20 time: 0.112476 Jul 02 03:35:04.040294 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 45/82] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:03 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:04.066064 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:04.066940 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:04.074357 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:04.074805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:04.075598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:04.076147 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:04.416210 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:04.426133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-effc8e95-5629-4661-8d23-ddb02a1dfe95 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.364092 Jul 02 03:35:04.435770 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 38/83] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:04 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:04.957586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:04.958336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:04.959040 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:04.963346 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:04.966458 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:04.966937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:04.967827 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:04.968252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:04.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:04.969990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:04.970815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:04.971209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:05.174202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:05.187271 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-80187685-c082-4f21-abb0-890281c59ad0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.237236 Jul 02 03:35:05.187870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 46/84] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:04 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:05.192484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:05.193091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:05.193917 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:05.200329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:05.201080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:05.202101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:05.202749 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:05.203456 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f49bebe5-e681-4a07-afaa-b57d22147bad tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.255039 Jul 02 03:35:05.204028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 39/85] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:04 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:05.266961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:05.275491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:05.277145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:05.278248 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c45b79ce-4f4b-4256-b968-edac9d7b55f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1338 microversion: 2.20 time: 0.089487 Jul 02 03:35:05.278803 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 47/86] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:05 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1338 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:05.441941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:05.442534 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:05.448793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:05.449251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:05.450057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:05.450479 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:05.596596 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:05.604880 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e9606a8a-52c5-4640-846c-153826a41fec tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.166737 Jul 02 03:35:05.605697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 40/87] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:05 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:06.203246 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:06.203872 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:06.209994 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.210441 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.211220 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.211665 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.220671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:06.221355 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:06.236919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.237375 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.238314 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.238750 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.412991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:06.420228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:06.422190 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f0d2e510-3af5-4ae0-a72d-3a202bfe7ae3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.222395 Jul 02 03:35:06.422915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 48/88] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:06 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:06.427623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:06.428721 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:06.434419 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.435144 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.435621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.436053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.438380 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-73df8f9c-29b6-4752-9ebd-5561969c3081 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.221395 Jul 02 03:35:06.439167 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 41/89] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:06 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:06.498912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:06.507992 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:06.509476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:06.510585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4174f82a-ba12-43f4-846f-c722b15efad8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1338 microversion: 2.20 time: 0.086698 Jul 02 03:35:06.511197 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 49/90] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:06 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1338 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:06.622377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:06.622982 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:06.636731 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.637234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.638174 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:06.638840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:06.770818 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:06.779673 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d2c20ebf-f968-4ce6-8f96-78bb84acae50 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.161034 Jul 02 03:35:06.780484 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 42/91] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:06 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:07.441338 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:07.442550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:07.456173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:07.457893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:07.464874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.465609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:07.466589 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.467000 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.467492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:07.467776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:07.468891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.470516 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:07.768108 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:07.771483 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:07.779826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-199767c2-3063-4313-8e90-af298d0b9f18 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.328561 Jul 02 03:35:07.781311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 43/92] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:07 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:07.787180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:07.788099 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:07.798690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.799319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:07.801532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.802129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:07.803807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c4085f37-ef99-4523-87db-08965ba0a574 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.362868 Jul 02 03:35:07.806293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 50/93] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:07 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:07.815910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:07.816798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:07.831935 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.832434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:07.833400 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:07.833849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:08.133987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:08.152834 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7ababb87-875c-4470-a850-8a392fd01c19 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.342332 Jul 02 03:35:08.153479 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 51/94] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:07 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:08.172207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:08.190897 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:08.197625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:08.198805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f812f12c-35ad-41ec-8b87-4c908a628523 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.416379 Jul 02 03:35:08.202471 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 44/95] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:07 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:08.302596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-75c78307-2fcd-47f2-aa60-7d2588aa2889 req-5c09ecc1-e467-4bbb-bd81-f2a3a870558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee71eb-cb9f-458e-96b2-4f6db8156153", "name": "network-vif-plugged", "status": "completed", "tag": "1d5c4d80-4bf3-4936-9cbd-a7174cf1642f"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:08.314075 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-75c78307-2fcd-47f2-aa60-7d2588aa2889 req-5c09ecc1-e467-4bbb-bd81-f2a3a870558d service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:08.314466 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-75c78307-2fcd-47f2-aa60-7d2588aa2889 req-5c09ecc1-e467-4bbb-bd81-f2a3a870558d service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:08.329678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-75c78307-2fcd-47f2-aa60-7d2588aa2889 req-5c09ecc1-e467-4bbb-bd81-f2a3a870558d service nova] Creating event network-vif-plugged:1d5c4d80-4bf3-4936-9cbd-a7174cf1642f for instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 on hv-cinder-84684 Jul 02 03:35:08.338458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-75c78307-2fcd-47f2-aa60-7d2588aa2889 req-5c09ecc1-e467-4bbb-bd81-f2a3a870558d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121647 Jul 02 03:35:08.342400 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 52/96] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:08.798902 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:08.799573 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:08.807604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:08.808327 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:08.809109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:08.809726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:08.825389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:08.826218 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:08.832854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:08.833472 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:08.834551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:08.835134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:09.016752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:09.024520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2174d126-81b0-4656-b9ca-dcde5f925b4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.231417 Jul 02 03:35:09.029963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 45/97] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:08 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:09.065704 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:09.080800 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-56dce7ff-c29f-469e-8077-2aeffc74d1c8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.261678 Jul 02 03:35:09.081379 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 53/98] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:08 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:09.170352 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:09.171232 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:09.182403 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:09.182821 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:09.183859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:09.184304 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:09.224241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:09.225466 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:09.233208 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:09.233831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:09.234815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:09.235524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:09.453616 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:09.469947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4993c016-612e-4050-a002-b9627be631bc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.304124 Jul 02 03:35:09.479641 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 46/99] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:09 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:09.482840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:09.492505 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:09.493945 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:09.495071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fedef242-903c-421c-b9e4-b7df59386d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.277563 Jul 02 03:35:09.499399 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 54/100] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:09 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:35:10.047070 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:10.047723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:10.054541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.054994 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.055829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.056270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.104118 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:10.114272 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:10.121336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.122000 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.123239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.124009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.275601 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:10.283356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-43aad714-b620-4930-8ca6-e8fcc784fe92 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.241041 Jul 02 03:35:10.283945 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 47/101] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:10 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:10.329510 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:10.337724 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-33d3cfa6-37f0-430b-ae5a-8f0420eef0cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.243230 Jul 02 03:35:10.338428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 55/102] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:10 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:10.490915 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:10.491751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:10.499619 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.500209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.501099 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.501692 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.517580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:10.520256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:10.536026 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.536946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.538625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:10.539229 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:10.713643 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:10.721362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ec185e00-a257-4050-ba6c-3e7cc41ce1f8 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.236414 Jul 02 03:35:10.721941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 48/103] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:10 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:10.737153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:10.739666 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:10.747100 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:10.748615 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:10.749784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1d96d738-c38b-4e34-b3b3-13a31b29bf2e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.236535 Jul 02 03:35:10.750333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 56/104] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:10 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:35:11.301346 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:11.301992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:11.308723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.309170 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.309941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.310357 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.357126 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:11.357737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:11.364910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.366169 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.367777 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.368221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.495725 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:11.503997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e1e0a5ec-997d-4f6d-9362-c904a2d6e565 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.206822 Jul 02 03:35:11.504556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 49/105] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:11 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:11.542291 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:11.552519 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ecac13a1-f572-4096-b618-e035c5cfdc9b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.199841 Jul 02 03:35:11.553547 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 57/106] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:11 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:11.738077 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:11.738688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:11.745552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.745985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.746751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.747193 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.767397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:11.767970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:11.774830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.775586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.776316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:11.777052 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:11.956413 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:11.960686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:11.964107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1a2a8ee5-142a-49db-9b59-6791def871ad tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.229883 Jul 02 03:35:11.964691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 50/107] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:11 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:11.969505 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:11.972295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:11.973407 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-60ec3d11-f7ed-4116-820e-1156464b4db5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.209902 Jul 02 03:35:11.973948 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 58/108] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:11 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:35:12.520154 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:12.520753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:12.526981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:12.527453 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:12.528229 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:12.528653 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:12.573186 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:12.573186 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:12.585410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:12.585870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:12.586750 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:12.590476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:12.729834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:12.738722 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dc815bb3-e0cb-4f40-9458-ee3f9f6e0a57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.222383 Jul 02 03:35:12.739440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 51/109] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:12 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:12.776081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:12.783967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-792b7793-096b-4aee-a699-1ed478cfdc24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.217875 Jul 02 03:35:12.784531 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 59/110] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:12 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:12.982308 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:12.982924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:12.994600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:12.995415 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:13.000054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.000503 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:13.001435 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.001871 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:13.002967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.003550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:13.004331 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.004949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:13.023795 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:13.209123 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:13.216777 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:13.229189 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:13.231279 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b5020bf0-0b4c-4fdb-896c-2f01faf5fbef tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.254196 Jul 02 03:35:13.233704 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:13.234118 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 52/111] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:12 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:13.235273 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5ba7b2e1-7dcd-45f2-ad6b-05e41b1d5ce8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.245338 Jul 02 03:35:13.235906 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 60/112] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:12 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:13.756215 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:13.756886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:13.764376 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.766477 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:13.767481 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.768974 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:13.801178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:13.813175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:13.815929 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=93 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:13.825641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.826084 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:13.826849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:13.827276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:14.364517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:14.368799 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:14.375697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ad0cdf52-5fd8-4450-90bd-5374c3c55f3b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.623185 Jul 02 03:35:14.383522 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 53/113] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:13 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:14.392935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:14.393697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:14.402433 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2b740539-ec34-4b6b-9095-4276f64cf597 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.605046 Jul 02 03:35:14.408202 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:14.409173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:14.410872 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:14.412132 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:14.412246 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 61/114] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:13 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:14.426444 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:14.426704 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:14.441046 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:14.442027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:14.442950 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:14.443733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:14.701869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:14.709717 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-84500392-8771-4158-9610-52b18484596a tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.323995 Jul 02 03:35:14.710862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 54/115] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:14 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:14.734397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:14.746903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:14.749139 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:14.750614 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a44db564-cda7-4751-9f00-f84666c878f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.332229 Jul 02 03:35:14.751282 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 62/116] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:14 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:15.210848 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-7b003893-f960-4671-9a17-58d9f4040000 req-6cbc157f-cf5d-4988-8bef-903816d55aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaef5120-b756-40f2-b615-a9786eb21a9c", "name": "network-vif-plugged", "status": "completed", "tag": "cb39fa4c-e4cc-46f8-8399-e7c6977c9420"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:15.230053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-7b003893-f960-4671-9a17-58d9f4040000 req-6cbc157f-cf5d-4988-8bef-903816d55aae service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.231889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-7b003893-f960-4671-9a17-58d9f4040000 req-6cbc157f-cf5d-4988-8bef-903816d55aae service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.255747 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-7b003893-f960-4671-9a17-58d9f4040000 req-6cbc157f-cf5d-4988-8bef-903816d55aae service nova] Creating event network-vif-plugged:cb39fa4c-e4cc-46f8-8399-e7c6977c9420 for instance aaef5120-b756-40f2-b615-a9786eb21a9c on hv-cinder-84684 Jul 02 03:35:15.270171 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-7b003893-f960-4671-9a17-58d9f4040000 req-6cbc157f-cf5d-4988-8bef-903816d55aae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065276 Jul 02 03:35:15.272643 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 55/117] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:15.398830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-87cc8a6f-ab99-4eba-981d-d30c6fa123b9 req-2b4044cc-8351-498d-9897-989abf4e3f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2d5a1f-4e5b-4072-851a-d01f23742f55", "tag": "01f88803-1998-4eea-820a-bbda30202ac5"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:15.399650 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:15.400428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:15.413712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-87cc8a6f-ab99-4eba-981d-d30c6fa123b9 req-2b4044cc-8351-498d-9897-989abf4e3f29 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.415034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-87cc8a6f-ab99-4eba-981d-d30c6fa123b9 req-2b4044cc-8351-498d-9897-989abf4e3f29 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.418373 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.418857 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.421732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.422187 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.447891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-87cc8a6f-ab99-4eba-981d-d30c6fa123b9 req-2b4044cc-8351-498d-9897-989abf4e3f29 service nova] Creating event network-changed:01f88803-1998-4eea-820a-bbda30202ac5 for instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 on hv-cinder-84684 Jul 02 03:35:15.467177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-87cc8a6f-ab99-4eba-981d-d30c6fa123b9 req-2b4044cc-8351-498d-9897-989abf4e3f29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068989 Jul 02 03:35:15.471193 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 56/118] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:15.485119 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:15.485781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:15.497657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.498141 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.498807 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.499239 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.694146 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:15.705208 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-40917e96-748e-4371-b8a0-c84f57b5fa4c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.316120 Jul 02 03:35:15.706022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 63/119] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:15 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:15.735285 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:15.739543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:15.747360 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.752718 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.755546 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.756191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.803400 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:15.816337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-70529350-8985-4375-a8e4-529337a75477 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.335423 Jul 02 03:35:15.817831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 57/120] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:15 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:15.823072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:15.823881 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:15.830255 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.830702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:15.833588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:15.834216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:16.038202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:16.053201 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6ccdeab8-12f1-4afa-9468-ed6627af5fa4 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.320067 Jul 02 03:35:16.055563 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 64/121] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:15 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:16.065736 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:16.075526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:16.078529 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:16.079721 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e58a6009-d142-429e-9597-9feb066dc228 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.260520 Jul 02 03:35:16.080481 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 58/122] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:15 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:16.727038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:16.728700 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:16.736758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:16.737213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:16.737989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:16.738420 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:16.836067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:16.837506 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:16.846369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:16.847261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:16.850228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:16.850858 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:17.040128 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:17.048441 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8479f1a9-2f04-4784-8ae5-380dccd844bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.326493 Jul 02 03:35:17.049006 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 65/123] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:16 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:17.067851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:17.076888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:17.078031 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:17.093121 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-bd57b59e-6f87-4f72-bbd1-740762498730 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.261102 Jul 02 03:35:17.094060 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 59/124] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:16 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:17.109914 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:17.110448 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:17.119240 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:17.119661 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:17.120382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:17.125576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:17.139367 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:17.140057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:17.144072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:17.151785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:17.444059 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:17.463607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-79a13232-9bbb-46a7-bef0-900e144ce498 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.388069 Jul 02 03:35:17.464937 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 66/125] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:17 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:17.478982 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:17.482713 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-0a119870-1bac-4788-ae81-60b50930d66b req-4244d95d-7f76-438b-8864-0d39662b521a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6102b173-1c0f-441b-8d00-2cd53314544d", "name": "network-vif-plugged", "status": "completed", "tag": "e02d1bfd-a033-4aa9-9067-1cfc9301fed1"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:17.500990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:17.503319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:17.507424 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b93f8fb5-1887-4621-a414-7c5a0e61add0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.391990 Jul 02 03:35:17.510588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 60/126] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:17 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:17.514990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-0a119870-1bac-4788-ae81-60b50930d66b req-4244d95d-7f76-438b-8864-0d39662b521a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:17.515670 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-0a119870-1bac-4788-ae81-60b50930d66b req-4244d95d-7f76-438b-8864-0d39662b521a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:17.544121 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-0a119870-1bac-4788-ae81-60b50930d66b req-4244d95d-7f76-438b-8864-0d39662b521a service nova] Creating event network-vif-plugged:e02d1bfd-a033-4aa9-9067-1cfc9301fed1 for instance 6102b173-1c0f-441b-8d00-2cd53314544d on hv-cinder-84684 Jul 02 03:35:17.555043 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-0a119870-1bac-4788-ae81-60b50930d66b req-4244d95d-7f76-438b-8864-0d39662b521a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088537 Jul 02 03:35:17.556569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 67/127] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:18.066986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:18.067810 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:18.081352 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.083382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:18.084595 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.085172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:18.144754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:18.150624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:18.188815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.189270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:18.200991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.201495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:18.645691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:18.654993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8f821037-4160-47ec-9795-41f758ad94b1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.594096 Jul 02 03:35:18.655812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 61/128] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:18 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:18.679941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:18.684251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:18.686326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:18.694399 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-92c58292-9cde-4a0c-b194-fa361174724e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.575054 Jul 02 03:35:18.694985 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 68/129] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:18 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:18.702077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:18.702682 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:18.705503 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.708256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:18.710292 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.710625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.711086 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:18.711253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:18.712182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:18.712757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:19.196580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:19.210365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:19.211883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:19.212993 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2ba1636b-ca07-479e-824c-9516dbe7e54f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.517064 Jul 02 03:35:19.213547 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 69/130] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:18 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:19.245126 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:19.254210 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-19db27d2-3f05-43fd-929a-ea87bc1851b0 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.583542 Jul 02 03:35:19.257866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 62/131] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:18 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:19.674599 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:19.675472 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:19.684987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:19.687328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:19.700471 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:19.701143 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:19.710083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:19.710689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:19.718561 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:19.719012 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:19.719807 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:19.720239 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:20.163794 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:20.173260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-48eb5586-98c9-4775-b93d-9b167bbcf1f4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.504370 Jul 02 03:35:20.174659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 70/132] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:19 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:20.202485 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:20.216463 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9f7e6719-5d6f-4eee-8c19-138f6402f099 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.510004 Jul 02 03:35:20.219344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 63/133] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:19 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:20.241515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:20.242775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:20.249677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:20.250423 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:20.251581 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:20.252184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:20.276009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:20.277717 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:20.291594 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:20.292685 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:20.294521 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:20.295775 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:20.736389 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:20.751930 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7578253c-6def-4d68-9e00-1cd48cac366f tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.476635 Jul 02 03:35:20.752901 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 64/134] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:20 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:20.754165 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:20.774293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:20.776510 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:20.779713 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-92f5ac95-c2d3-499b-acdd-2ac0f52e8df0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.546913 Jul 02 03:35:20.793061 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 71/135] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:20 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:21.190928 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:21.191757 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:21.199234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.199827 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:21.200833 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.201553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:21.253802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:21.259994 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:21.268829 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.269358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:21.272710 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.280602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:21.533415 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:21.546384 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-83011cf9-51db-4366-a3de-e8af9759e70c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.360028 Jul 02 03:35:21.546978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 65/136] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:21 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:21.568132 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:21.576561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-26b31e1c-77fe-4adc-9e1d-02808064bf1d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1322 microversion: 2.1 time: 0.343246 Jul 02 03:35:21.578006 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 72/137] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:21 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:21.770427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:21.771334 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:21.780994 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.781724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:21.783110 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.784002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:21.801129 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:21.803792 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:21.827259 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.828860 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:21.832472 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:21.835606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:22.172813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:22.181616 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8694e7f4-e144-4888-abc3-99a5b374c9f6 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1315 microversion: 2.1 time: 0.416883 Jul 02 03:35:22.192728 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 66/138] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:21 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:22.209995 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:22.219527 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:22.221009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:22.225157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8560bc9e-f3f5-47bd-9cb4-eb9b8bc11a91 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.430767 Jul 02 03:35:22.226506 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 73/139] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:21 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:35:22.288567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-5cb41040-ce53-4247-83da-5db967d90ec8 req-82800a14-8520-4ae7-8135-14931aed0ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e880e075-40f8-4727-b142-83ae3e2c6d03", "name": "network-vif-plugged", "status": "completed", "tag": "54a638db-254c-4005-b3f3-014e45f9ff9e"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:22.311945 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-5cb41040-ce53-4247-83da-5db967d90ec8 req-82800a14-8520-4ae7-8135-14931aed0ee0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:22.313034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-5cb41040-ce53-4247-83da-5db967d90ec8 req-82800a14-8520-4ae7-8135-14931aed0ee0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:22.362138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-5cb41040-ce53-4247-83da-5db967d90ec8 req-82800a14-8520-4ae7-8135-14931aed0ee0 service nova] Creating event network-vif-plugged:54a638db-254c-4005-b3f3-014e45f9ff9e for instance e880e075-40f8-4727-b142-83ae3e2c6d03 on hv-cinder-84684 Jul 02 03:35:22.393002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-5cb41040-ce53-4247-83da-5db967d90ec8 req-82800a14-8520-4ae7-8135-14931aed0ee0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109205 Jul 02 03:35:22.395824 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 67/140] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:22.563585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:22.564303 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:22.580571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:22.585878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:22.589385 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:22.589949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:22.595335 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:22.596435 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:22.610530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:22.614102 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:22.616335 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:22.618114 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:22.620021 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:22.886178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:22.897976 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-72847a96-905c-417f-8d86-8e8ea81c7d4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.335026 Jul 02 03:35:22.899060 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 74/141] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:22 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:22.966703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:23.003827 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-604e4588-33a9-400a-94a8-938d2a107747 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1515 microversion: 2.1 time: 0.408550 Jul 02 03:35:23.006912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 68/142] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:22 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1515 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:23.023769 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:23.025629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:23.037091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.041053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:23.042228 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.042882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:23.195555 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lazy-loading 'flavor' on Instance uuid 6102b173-1c0f-441b-8d00-2cd53314544d {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:35:23.200870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:23.201799 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:23.208472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.209168 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:23.210304 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.210939 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:23.383229 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:23.393329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-845e497c-5de8-4e57-a1b1-109f34bc9ced tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1501 microversion: 2.1 time: 0.196489 Jul 02 03:35:23.406713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 69/143] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:23 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1501 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:23.424514 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:23.425368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:23.433621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.434334 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:23.435254 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.435886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:23.457367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2724c478-d4d8-4a2e-a3d8-6c8d02afff63 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d/action" status: 200 len: 32 microversion: 2.1 time: 0.437880 Jul 02 03:35:23.458006 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 75/144] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:35:23 2022] POST /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d/action => generated 32 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:35:23.468326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:23.469280 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:23.485577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.486025 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:23.487024 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:23.487495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:24.212677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:24.223747 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-57cd3f33-f21d-4e4a-aa7a-983d350d069a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.760054 Jul 02 03:35:24.230756 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 76/145] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:23 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:24.243541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:24.244173 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:24.267284 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:24.267772 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:24.272332 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:24.272809 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:24.289757 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:24.302302 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:24.304314 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:24.305447 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fac63ef8-35d1-4d9b-a73d-8585e7ddff47 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.897277 Jul 02 03:35:24.306023 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 70/146] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:23 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:24.636294 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:24.652693 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1014381f-b97c-41b2-b42b-92a203fd0cce tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.416739 Jul 02 03:35:24.657795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 77/147] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:24 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:25.239141 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-63a53adc-f13c-4e47-aa30-457ed826bbce tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "379b8e31-257a-4379-ae01-d1e2c79f38a0"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:25.240755 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-63a53adc-f13c-4e47-aa30-457ed826bbce tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:25.243955 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=96 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:25.247615 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:25.248508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:25.256450 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.261185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:25.261682 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63a53adc-f13c-4e47-aa30-457ed826bbce tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.262311 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.266446 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:25.269593 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63a53adc-f13c-4e47-aa30-457ed826bbce tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:25.274283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63a53adc-f13c-4e47-aa30-457ed826bbce tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.276532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63a53adc-f13c-4e47-aa30-457ed826bbce tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:25.343049 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:25.570229 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:25.578662 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-339f8fec-c1c7-4f63-9ded-034e3574fc65 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.335315 Jul 02 03:35:25.589851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 78/148] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:25 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:25.594923 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:25.595859 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:25.603070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.603828 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:25.604898 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.605557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:25.845001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:25.853487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:25.854982 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:25.856125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9d826a59-fd7c-4056-9f6f-8eb049c82ae8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.265213 Jul 02 03:35:25.856693 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 79/149] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:25 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:25.861067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:25.861683 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:25.868021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.868703 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:25.869464 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:25.869900 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:26.022104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:26.029653 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-750190d5-7a61-40a6-8a84-b1af70bc5350 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.172002 Jul 02 03:35:26.030218 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 80/150] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:25 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:26.596398 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:26.597682 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:26.604985 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:26.605572 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:26.606354 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:26.606791 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:26.846277 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:26.855681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f1fd8ac0-f80c-48e1-a767-5631149bbb08 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.263047 Jul 02 03:35:26.865626 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 81/151] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:26 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:26.873884 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:26.880260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:26.891085 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:26.891843 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:26.892685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:26.893520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:27.180903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:27.190865 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:27.192841 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:27.194322 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2afb5b07-8b31-41bf-9967-2c380e5b52f6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.324317 Jul 02 03:35:27.195392 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 82/152] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:26 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:27.200746 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:27.201526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:27.208205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:27.208891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:27.210121 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:27.210699 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:27.495345 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:27.507629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8c2717e8-827b-40be-9897-2b34f5792e2c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1366 microversion: 2.1 time: 0.310646 Jul 02 03:35:27.508627 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 83/153] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:27 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:27.875843 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:27.877580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:27.894384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:27.895002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:27.901148 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:27.901963 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:28.121900 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:28.130512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a3df99eb-ef8c-4763-aac2-1640f08d4587 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.259833 Jul 02 03:35:28.134501 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 84/154] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:27 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:28.214078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:28.214918 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:28.223553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:28.224293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:28.225493 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:28.226128 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:28.304417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-63a53adc-f13c-4e47-aa30-457ed826bbce tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "POST /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.071425 Jul 02 03:35:28.312349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 71/155] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:35:25 2022] POST /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c/os-volume_attachments => generated 194 bytes in 3081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:28.483560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:28.504265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:28.504265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:28.504265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-224ec28f-3e54-48e9-a112-4910f9fbba02 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.287621 Jul 02 03:35:28.504569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 85/156] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:28 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:35:28.539362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:28.540205 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:28.559558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:28.562662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:28.563901 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:28.565152 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:28.898924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:28.926992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8c8bcfad-c773-4542-beb3-7917a765b92b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1557 microversion: 2.1 time: 0.398404 Jul 02 03:35:28.942679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 72/157] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:28 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1557 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:28.946064 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2616a8af-96f1-4a4a-abb5-7ab45aaf0fc1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:28.946565 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2616a8af-96f1-4a4a-abb5-7ab45aaf0fc1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:28.955011 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2616a8af-96f1-4a4a-abb5-7ab45aaf0fc1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:28.955495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2616a8af-96f1-4a4a-abb5-7ab45aaf0fc1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:28.956662 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2616a8af-96f1-4a4a-abb5-7ab45aaf0fc1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:28.957109 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2616a8af-96f1-4a4a-abb5-7ab45aaf0fc1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:29.063479 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2616a8af-96f1-4a4a-abb5-7ab45aaf0fc1 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121419 Jul 02 03:35:29.064827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 86/158] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:35:28 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:29.151034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:29.151687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:29.165244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:29.165761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:29.166584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:29.170519 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:29.516228 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:29.516881 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:29.527107 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:29.527588 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:29.528375 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:29.528879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:30.031716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:30.042884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7dc8ff6d-6def-4aff-800a-2c6bb3caa375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.896668 Jul 02 03:35:30.045792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 73/159] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:29 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:30.745593 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:30.760463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:30.778053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:30.781922 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-67b5b570-9741-405b-ac8a-ad6bf9d6f55d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 1.267100 Jul 02 03:35:30.795219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 87/160] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:29 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:35:31.064338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:31.065065 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:31.084730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:31.100597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:31.101782 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:31.102242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:31.496516 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:31.506753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-023bffb3-035a-4c0c-9cfc-77a723a32e62 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.446520 Jul 02 03:35:31.509768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 74/161] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:31 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:31.558096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-6490af02-b4cf-4440-ae4f-8425b227f833 req-708fb933-88f3-4e84-9bf1-8f6364afcf4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e880e075-40f8-4727-b142-83ae3e2c6d03", "tag": "54a638db-254c-4005-b3f3-014e45f9ff9e"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:31.570807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-6490af02-b4cf-4440-ae4f-8425b227f833 req-708fb933-88f3-4e84-9bf1-8f6364afcf4a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:31.571254 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-6490af02-b4cf-4440-ae4f-8425b227f833 req-708fb933-88f3-4e84-9bf1-8f6364afcf4a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:31.584186 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-6490af02-b4cf-4440-ae4f-8425b227f833 req-708fb933-88f3-4e84-9bf1-8f6364afcf4a service nova] Creating event network-changed:54a638db-254c-4005-b3f3-014e45f9ff9e for instance e880e075-40f8-4727-b142-83ae3e2c6d03 on hv-cinder-84684 Jul 02 03:35:31.590013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-6490af02-b4cf-4440-ae4f-8425b227f833 req-708fb933-88f3-4e84-9bf1-8f6364afcf4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035761 Jul 02 03:35:31.590836 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 88/162] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:31.800546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:31.801157 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:31.818826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:31.819282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:31.820083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:31.820523 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:32.082987 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:32.096904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:32.098558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:32.099783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9acf9a92-4e77-47cc-85ff-c2198ba9ae24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.303638 Jul 02 03:35:32.100394 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 75/163] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:31 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:32.525595 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:32.526320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:32.541648 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:32.543661 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:32.550778 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:32.551257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:32.753793 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:32.765362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:32.768069 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5c10cc00-1475-4548-bab2-f7c084b227a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.247021 Jul 02 03:35:32.768812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 89/164] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:32 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:33.020442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-57d91fd7-2837-4faa-a258-19ac5f9fab1c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Action: 'create', calling method: .version_select at 0x7f2e9c2394c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-909464848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr5bSd1CbgDsJwJgBNbR95PBpiYrK7D3QOMm6eoWk6PzCfXfZ9eKhP3SCfIke0zaNEByKSJ6H7XNMivpo4Ej70d2g0UaYmuX7+jmsFXaseoeIQdqb0duTQ1Dw5x5M3iOQ=="}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:33.047448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-57d91fd7-2837-4faa-a258-19ac5f9fab1c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Getting quotas for project 6c04290d87154e48a3bf77a828b563ba. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:35:33.068236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-57d91fd7-2837-4faa-a258-19ac5f9fab1c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Getting quotas for user 4f509b8a8e3c4bc3a5143d44c078d939 and project 6c04290d87154e48a3bf77a828b563ba. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:35:33.118220 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:33.119120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:33.130258 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-57d91fd7-2837-4faa-a258-19ac5f9fab1c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.315924 Jul 02 03:35:33.131549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 76/165] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:35:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:33.135445 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:33.135556 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:33.138522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:33.139151 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:33.302966 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:33.312658 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:33.314225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:33.315376 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3d2fc51e-f962-4133-94cd-cfa8186e9140 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.201151 Jul 02 03:35:33.316963 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 90/166] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:33 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:33.785370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:33.785979 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:33.793333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:33.793989 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:33.795251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:33.799830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:33.999590 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:34.010120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9e1cda82-55c6-4bd7-a292-2fd455557e2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.228594 Jul 02 03:35:34.011140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 77/167] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:33 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:34.336565 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:34.337194 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:34.352520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:34.355231 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:34.359770 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:34.360452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:34.551783 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:34.565630 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:34.567440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:34.569303 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-63ff3efb-60e8-4eea-8813-9a57f362c0e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.237684 Jul 02 03:35:34.582579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 91/168] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:34 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:35.039995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:35.040702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:35.049160 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:35.049698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:35.051216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:35.051723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:35.215463 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:35.227608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-95f3744c-f6d4-4e49-830f-5cf0f9429605 req-5e3b073d-57f1-4c77-ac72-74d6f1a2d254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2d5a1f-4e5b-4072-851a-d01f23742f55", "name": "network-vif-plugged", "status": "completed", "tag": "01f88803-1998-4eea-820a-bbda30202ac5"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:35.233639 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-954458ee-5a38-410c-86ba-a918bcd5c8d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.196303 Jul 02 03:35:35.234621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 78/169] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:35 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:35.245745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-95f3744c-f6d4-4e49-830f-5cf0f9429605 req-5e3b073d-57f1-4c77-ac72-74d6f1a2d254 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:35.246185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-95f3744c-f6d4-4e49-830f-5cf0f9429605 req-5e3b073d-57f1-4c77-ac72-74d6f1a2d254 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:35.258523 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-95f3744c-f6d4-4e49-830f-5cf0f9429605 req-5e3b073d-57f1-4c77-ac72-74d6f1a2d254 service nova] Creating event network-vif-plugged:01f88803-1998-4eea-820a-bbda30202ac5 for instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 on hv-cinder-84684 Jul 02 03:35:35.263247 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-95f3744c-f6d4-4e49-830f-5cf0f9429605 req-5e3b073d-57f1-4c77-ac72-74d6f1a2d254 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039577 Jul 02 03:35:35.263915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 92/170] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:35.590752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:35.591522 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:35.603845 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:35.606236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:35.609639 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:35.611239 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:35.774647 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:35.784422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:35.786437 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:35.787845 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-eab1dd1a-f2d1-48e7-9a6b-848cef2aaba8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.201861 Jul 02 03:35:35.798890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 79/171] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:35 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:36.250867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:36.251574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:36.258252 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:36.258618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:36.259424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:36.259871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:36.417529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:36.426036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ed9e6936-15cd-4285-9ec4-94e111511866 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.179459 Jul 02 03:35:36.426608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 93/172] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:36 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:36.806586 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:36.807201 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:36.814085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:36.814496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:36.815282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:36.815741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:36.996946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:36.999851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:37.001351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:37.002467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6b9b9bbf-2c77-49eb-b908-25df6bd36a6d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.200411 Jul 02 03:35:37.003371 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 80/173] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:36 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:37.444576 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:37.445160 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:37.452599 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:37.453065 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:37.453835 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:37.454270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:37.593118 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:37.601917 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a02adf6b-62df-4beb-9d64-318fb87fb7b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.161869 Jul 02 03:35:37.602490 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 94/174] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:37 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:38.020967 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:38.021630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:38.030923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.030923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.030923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.030923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.208228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:38.217898 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:38.219688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:38.220786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cf53d800-50a9-42e9-a224-881cf4b63875 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.203794 Jul 02 03:35:38.221509 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 81/175] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:38 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:38.388266 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:38.388997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:38.395034 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.395670 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.396738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.397168 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.425295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:35:38.515171 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2603d001-d7ec-453d-b8d0-1500fb137aea tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 204 len: 0 microversion: 2.1 time: 0.130383 Jul 02 03:35:38.515944 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 95/176] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:35:38 2022] DELETE /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:35:38.525067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:38.525662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:38.531812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.532499 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.533557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.534127 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.620733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:38.621740 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:38.629562 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.630008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.631214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:38.631734 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:38.666867 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:38.675372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ddc3dc97-b5ae-4874-acc1-44c57b69b998 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1553 microversion: 2.1 time: 0.154311 Jul 02 03:35:38.675946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 82/177] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:38 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:38.772095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:38.782888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d1c1179e-36a5-409f-b48f-3a5d3e12d8ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.167852 Jul 02 03:35:38.783741 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 96/178] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:38 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:39.241225 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:39.241839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:39.248887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:39.249341 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:39.250102 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:39.250540 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:39.387916 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:39.397855 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:39.399746 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:39.401038 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2b54dcf8-787e-4ef2-a0df-289d33181295 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.163960 Jul 02 03:35:39.401778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 83/179] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:39 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:39.693789 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:39.697706 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:39.705471 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:39.706104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:39.707034 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:39.707644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:39.802919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:39.803664 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:39.814703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:39.816604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:39.817662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:39.818456 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:39.904621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:39.917330 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8f1dee91-71e5-4b9f-a25e-905829e7dae2 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1553 microversion: 2.1 time: 0.227780 Jul 02 03:35:39.918722 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 97/180] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:39 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:40.003947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:40.012796 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-63dd0d28-f8d2-4aa3-ba32-5cd83a1875a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.215709 Jul 02 03:35:40.013361 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 84/181] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:39 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:40.420464 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:40.421062 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:40.427199 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:40.427701 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:40.428468 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:40.428896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:40.570638 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:40.578839 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:40.580357 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:40.581438 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f5bfcfd6-7564-4604-a0d1-c2817df36368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1406 microversion: 2.20 time: 0.165460 Jul 02 03:35:40.581997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 98/182] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:40 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:40.936588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:40.937253 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:40.944627 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:40.945434 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:40.952769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:40.953263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:41.030439 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:41.031036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:41.037550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:41.038222 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:41.039008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:41.039477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:41.167583 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:41.182694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-edd5bee6-3476-4db7-a88a-5eaf93813b45 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1553 microversion: 2.1 time: 0.247834 Jul 02 03:35:41.183416 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 85/183] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:40 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:41.251487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:41.259137 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f0a8f646-b405-452e-b545-5a86d89d0ed3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.232903 Jul 02 03:35:41.259757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 99/184] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:41 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:41.601072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:41.601681 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:41.608491 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:41.609169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:41.610357 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:41.611043 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:41.813927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:41.823584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:41.825200 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:41.826507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d65f23aa-c00e-477b-857d-d1ac37298442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1599 microversion: 2.20 time: 0.230216 Jul 02 03:35:41.837155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 86/185] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:35:41 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1599 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:35:41.846972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-89ccc053-b2a1-4e35-86ba-514514b157b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:41.847594 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-89ccc053-b2a1-4e35-86ba-514514b157b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:41.855077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89ccc053-b2a1-4e35-86ba-514514b157b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:41.855543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89ccc053-b2a1-4e35-86ba-514514b157b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:41.856310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89ccc053-b2a1-4e35-86ba-514514b157b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:41.856737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89ccc053-b2a1-4e35-86ba-514514b157b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:41.947161 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-89ccc053-b2a1-4e35-86ba-514514b157b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104123 Jul 02 03:35:41.948445 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 100/186] 10.222.0.42 () {60 vars in 1315 bytes} [Sat Jul 2 03:35:41 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:35:42.202409 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:42.204401 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:42.213333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:42.214983 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:42.216606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:42.217227 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:42.278056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:42.279391 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:42.280776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:42.291399 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:42.292753 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:42.301416 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:42.302251 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:42.847940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:42.864015 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-96fc4f3d-8ab0-40a0-bf90-9fa6f60dbc1f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.590159 Jul 02 03:35:42.865517 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 101/187] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:42 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:42.884238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:42.899741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-672e73e6-1b3b-4a78-acbd-7999003626c9 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1553 microversion: 2.1 time: 0.703126 Jul 02 03:35:42.900809 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 87/188] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:42 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1553 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:43.461076 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-ef7c5d82-d675-4782-8d2a-a974b2e37730 req-f86d4cb0-1fa1-4b28-b363-2e9daa5b981a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaef5120-b756-40f2-b615-a9786eb21a9c", "name": "network-vif-deleted", "tag": "cb39fa4c-e4cc-46f8-8399-e7c6977c9420"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:43.474372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-ef7c5d82-d675-4782-8d2a-a974b2e37730 req-f86d4cb0-1fa1-4b28-b363-2e9daa5b981a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:43.474816 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-ef7c5d82-d675-4782-8d2a-a974b2e37730 req-f86d4cb0-1fa1-4b28-b363-2e9daa5b981a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:43.490583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-ef7c5d82-d675-4782-8d2a-a974b2e37730 req-f86d4cb0-1fa1-4b28-b363-2e9daa5b981a service nova] Creating event network-vif-deleted:cb39fa4c-e4cc-46f8-8399-e7c6977c9420 for instance aaef5120-b756-40f2-b615-a9786eb21a9c on hv-cinder-84684 Jul 02 03:35:43.495674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-ef7c5d82-d675-4782-8d2a-a974b2e37730 req-f86d4cb0-1fa1-4b28-b363-2e9daa5b981a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042282 Jul 02 03:35:43.496324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 102/189] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:43.625042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-95cbbfb0-e38d-4195-a4ed-d1a9a8b26ae2 req-0f0584b2-b913-4617-881f-dd840be4abd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2d5a1f-4e5b-4072-851a-d01f23742f55", "tag": "01f88803-1998-4eea-820a-bbda30202ac5"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:35:43.632458 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=4 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:43.642231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-95cbbfb0-e38d-4195-a4ed-d1a9a8b26ae2 req-0f0584b2-b913-4617-881f-dd840be4abd0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:43.642599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-95cbbfb0-e38d-4195-a4ed-d1a9a8b26ae2 req-0f0584b2-b913-4617-881f-dd840be4abd0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:43.654730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-95cbbfb0-e38d-4195-a4ed-d1a9a8b26ae2 req-0f0584b2-b913-4617-881f-dd840be4abd0 service nova] Creating event network-changed:01f88803-1998-4eea-820a-bbda30202ac5 for instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 on hv-cinder-84684 Jul 02 03:35:43.659835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-95cbbfb0-e38d-4195-a4ed-d1a9a8b26ae2 req-0f0584b2-b913-4617-881f-dd840be4abd0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038427 Jul 02 03:35:43.660437 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 88/190] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:43.883853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:43.884889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:43.888237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:43.899947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:43.900676 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:43.901457 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:43.902232 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:43.919038 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:43.920339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:43.939136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:43.939884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:43.940825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:43.941428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:44.108180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028859afbab40df9fc4e5ea6d876931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc7a5a95d14f60b1a73198c8b5309b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:44.121375 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ab730816-73c5-4b76-9136-1132750e7b15 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 200 len: 1346 microversion: 2.1 time: 0.207524 Jul 02 03:35:44.133413 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 89/191] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:43 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 1346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:35:44.177639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:44.187600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d124962c-1294-43a0-aa5c-897f4c3461be tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.309354 Jul 02 03:35:44.191664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 103/192] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:43 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:45.150474 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:45.151703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:45.158863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:45.159599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:45.160378 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:45.160964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:45.187070 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] HTTP exception thrown: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Request method failure captured: Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c HTTP/1.1 Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7y_75goz1zE3O_pCHCGB2qHNk51POVqcjNz5lJ2K3EpL8xVNpie1TgR-sACD3Ry4WfsaytzYlUWr0QOOFqBymCXIzjtIEn_ZEqTCxR4QRBMO4urlOGJSaZYxij6Qo87JdgUxyUDIGBn1JdeA9KyMEVfzZoURCRoulR5juQqz2gFDdM Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:35:45.192208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dedc7a5a95d14f60b1a73198c8b5309b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 9028859afbab40df9fc4e5ea6d876931 Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.194422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'aaef5120-b756-40f2-b615-a9786eb21a9c'} Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:35:45.195138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.196708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.197891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Returning 404 to user: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:35:45.197891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-23102817-00c7-4eeb-b254-147e44773ddc tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 404 len: 111 microversion: 2.1 time: 0.048017 Jul 02 03:35:45.197891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 90/193] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:45 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:35:45.209195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:45.209845 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:45.216340 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:45.216966 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:45.217968 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:45.218526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:45.325051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:45.326399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:45.334694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:45.335195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:45.336016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:45.336400 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:45.360955 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] HTTP exception thrown: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Request method failure captured: Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c/os-volume_attachments HTTP/1.1 Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7y_75goz1zE3O_pCHCGB2qHNk51POVqcjNz5lJ2K3EpL8xVNpie1TgR-sACD3Ry4WfsaytzYlUWr0QOOFqBymCXIzjtIEn_ZEqTCxR4QRBMO4urlOGJSaZYxij6Qo87JdgUxyUDIGBn1JdeA9KyMEVfzZoURCRoulR5juQqz2gFDdM Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:35:45.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dedc7a5a95d14f60b1a73198c8b5309b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 9028859afbab40df9fc4e5ea6d876931 Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.364931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'server_id': 'aaef5120-b756-40f2-b615-a9786eb21a9c'} Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:35:45.366886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:45.368172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:45.370094 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Returning 404 to user: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:35:45.370094 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-96306f19-6626-4215-ba91-da53d269ef8d tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050112 Jul 02 03:35:45.370094 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 91/194] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:35:45 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:35:45.398431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:45.407146 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b3c659d4-296b-4cbd-be04-ab5648c1e62a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.202035 Jul 02 03:35:45.408029 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 104/195] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:45 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:46.425836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:46.427275 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:46.434726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:46.435187 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:46.435996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:46.436429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:46.602262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:46.602810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:46.609465 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:46.609905 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:46.610669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:46.611095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:46.611651 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:46.620764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-87058688-e3b6-48fa-bd43-ce3514fbbb2f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.198717 Jul 02 03:35:46.625534 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 92/196] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:46 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:46.633439 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] HTTP exception thrown: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Request method failure captured: Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c HTTP/1.1 Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7y_75goz1zE3O_pCHCGB2qHNk51POVqcjNz5lJ2K3EpL8xVNpie1TgR-sACD3Ry4WfsaytzYlUWr0QOOFqBymCXIzjtIEn_ZEqTCxR4QRBMO4urlOGJSaZYxij6Qo87JdgUxyUDIGBn1JdeA9KyMEVfzZoURCRoulR5juQqz2gFDdM Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:35:46.638842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dedc7a5a95d14f60b1a73198c8b5309b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 9028859afbab40df9fc4e5ea6d876931 Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.640269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'aaef5120-b756-40f2-b615-a9786eb21a9c'} Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:35:46.641152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.642221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.643569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Returning 404 to user: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:35:46.643569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e29a25e9-6d25-4776-99ed-789eede49c4e tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 404 len: 111 microversion: 2.1 time: 0.042595 Jul 02 03:35:46.643569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 105/197] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:35:46 2022] DELETE /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 03:35:46.652598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:46.653335 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] [instance: aaef5120-b756-40f2-b615-a9786eb21a9c] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:46.663058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:46.663552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:46.664932 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:46.665620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:46.683273 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] HTTP exception thrown: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Request method failure captured: Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c HTTP/1.1 Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7y_75goz1zE3O_pCHCGB2qHNk51POVqcjNz5lJ2K3EpL8xVNpie1TgR-sACD3Ry4WfsaytzYlUWr0QOOFqBymCXIzjtIEn_ZEqTCxR4QRBMO4urlOGJSaZYxij6Qo87JdgUxyUDIGBn1JdeA9KyMEVfzZoURCRoulR5juQqz2gFDdM Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:35:46.685176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dedc7a5a95d14f60b1a73198c8b5309b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dedc7a5a95d14f60b1a73198c8b5309b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: dedc7a5a95d14f60b1a73198c8b5309b Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025892403 Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 9028859afbab40df9fc4e5ea6d876931 Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-DeleteServersTestJSON-2025892403-project Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.686417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'aaef5120-b756-40f2-b615-a9786eb21a9c'} Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:35:46.687189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. Jul 02 03:35:46.689002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:35:46.690302 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] Returning 404 to user: Instance aaef5120-b756-40f2-b615-a9786eb21a9c could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:35:46.690302 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-62600406-8d37-4251-84e8-667a90d47226 tempest-DeleteServersTestJSON-2025892403 tempest-DeleteServersTestJSON-2025892403-project] 10.222.0.42 "GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c" status: 404 len: 111 microversion: 2.1 time: 0.040913 Jul 02 03:35:46.691179 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 93/198] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:46 2022] GET /compute/v2.1/servers/aaef5120-b756-40f2-b615-a9786eb21a9c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:35:47.642684 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:47.643279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:47.650228 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:47.650976 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:47.651926 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:47.652484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:47.822529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:47.830293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3cc9be53-8d69-45f8-b8a0-aa28a9adb535 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.191483 Jul 02 03:35:47.831191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 106/199] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:47 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:48.847787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:48.848405 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:48.857740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:48.862735 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:48.863718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:48.864267 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:49.163103 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:49.179207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-aad97f7f-b13b-4310-b59d-8580fe777261 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.334996 Jul 02 03:35:49.185203 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 94/200] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:48 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:50.198183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:50.199569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:50.214968 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:50.216202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:50.217382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:50.218092 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:50.268578 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:50.831518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:50.841474 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-845e1228-4ea8-4a79-89a4-a7bef33a06b7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.648274 Jul 02 03:35:50.854348 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 107/201] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:50 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:51.861073 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:51.861742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:51.870582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:51.871895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:51.873548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:51.874174 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:52.032300 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:52.040822 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a61d3be0-5970-4621-93c1-29cc399c86d6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.183629 Jul 02 03:35:52.041648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 95/202] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:51 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:53.058408 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:53.059030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:53.065168 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:53.065701 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:53.066453 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:53.066899 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:53.205903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:53.213918 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f3b30a33-1b7a-493d-a805-dc774a07c809 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.159521 Jul 02 03:35:53.214562 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 108/203] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:53 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:53.926526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c10625ab-5515-4d88-b046-033d236f2eed tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c0603a0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:53.981666 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c10625ab-5515-4d88-b046-033d236f2eed tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/67451b42-0d21-416d-ac13-61a7b0f9d725" status: 200 len: 350 microversion: 2.1 time: 0.058685 Jul 02 03:35:53.982246 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 96/204] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:35:53 2022] GET /compute/v2.1/os-volumes/67451b42-0d21-416d-ac13-61a7b0f9d725 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:54.234452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:54.235123 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:54.242104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:54.242544 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:54.243341 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:54.243752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:54.382813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:54.390499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fe8f16d6-7a2e-47e8-9fd6-89adc7f517cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.161058 Jul 02 03:35:54.391125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 109/205] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:54 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:55.408777 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:55.409378 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:55.411462 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:55.417665 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:55.418111 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:55.418876 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:55.419331 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:55.562126 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:55.571325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-260b0f8a-454f-4960-840e-3910ac7462e0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.167058 Jul 02 03:35:55.572122 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 97/206] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:55 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:56.402193 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9d817ed8-ae31-493a-a76d-176f0a27245c tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c0c33a0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:56.487903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9d817ed8-ae31-493a-a76d-176f0a27245c tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b4dbd846-95f0-49a5-ba41-97977c5792e2" status: 200 len: 351 microversion: 2.1 time: 0.089764 Jul 02 03:35:56.488492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 110/207] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:35:56 2022] GET /compute/v2.1/os-volumes/b4dbd846-95f0-49a5-ba41-97977c5792e2 => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:35:56.589073 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:56.590269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:56.600177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:56.601182 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:56.602935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:56.603408 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:56.817740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:56.829034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e836444f-00ef-4506-8d9f-cdbf6832795e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.244205 Jul 02 03:35:56.829609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 98/208] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:56 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:57.846719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:57.847960 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:57.855929 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:57.857119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:57.858689 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:57.861144 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:58.014172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:58.023366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-37706f6b-1ab9-4098-8162-4c14a0ede708 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.180953 Jul 02 03:35:58.023978 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 111/209] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:57 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:35:59.040399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:35:59.041071 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:35:59.048037 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:59.048759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:59.049581 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:35:59.050075 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:35:59.183776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:35:59.192761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5f737bf0-0c8f-49b6-be32-871d9689abef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.156134 Jul 02 03:35:59.193464 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 99/210] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:35:59 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:00.210473 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:00.210997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:00.217435 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:00.217889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:00.218652 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:00.219087 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:00.360779 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:00.370032 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e56fbc71-f161-42ea-bcaf-4e5633e511b8 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.163927 Jul 02 03:36:00.379387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 112/211] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:00 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:01.391356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:01.392161 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:01.403028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:01.403878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:01.405487 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:01.406229 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:01.539583 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:01.552393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fdbbb06f-19ce-47b9-91f0-3880e93a9b59 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.167535 Jul 02 03:36:01.553007 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 100/212] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:01 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:02.571714 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:02.572724 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:02.582497 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:02.583089 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:02.583904 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:02.584328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:02.727995 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:02.736180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-57284a78-485d-49f7-afbd-e17283e62aae tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.170789 Jul 02 03:36:02.736748 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 113/213] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:02 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:03.753299 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:03.753898 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:03.760889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:03.761275 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:03.762031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:03.762462 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:03.894948 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:03.903096 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-32cc32e6-e4d2-4d92-a9f8-b068ffea0ffc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.153785 Jul 02 03:36:03.903721 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 101/214] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:03 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:04.271394 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-313f3c4a-7e86-4113-95d8-9b363fcd542f tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c084550>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.337028 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-313f3c4a-7e86-4113-95d8-9b363fcd542f tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6377b17c-897d-42ff-9446-c33babf333c7" status: 200 len: 350 microversion: 2.1 time: 0.069408 Jul 02 03:36:04.337912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 114/215] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes/6377b17c-897d-42ff-9446-c33babf333c7 => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:36:04.349442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6ce7f6e7-4b32-446b-94c3-630aad682d98 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c04a310>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.451429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6ce7f6e7-4b32-446b-94c3-630aad682d98 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.105683 Jul 02 03:36:04.452408 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 102/216] 10.222.0.42 () {58 vars in 1133 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:04.467738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-41811594-117c-4275-891a-36753ca72b50 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c0849d0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.552942 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-41811594-117c-4275-891a-36753ca72b50 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088609 Jul 02 03:36:04.553452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 115/217] 10.222.0.42 () {58 vars in 1148 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:36:04.565343 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f96e41b3-6996-42d3-96a7-398716344a35 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c04a940>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.646944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f96e41b3-6996-42d3-96a7-398716344a35 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085316 Jul 02 03:36:04.647597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 103/218] 10.222.0.42 () {58 vars in 1133 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:04.658846 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a235665a-932d-40fe-9f7f-e16078ed53a0 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c0175e0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.748419 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a235665a-932d-40fe-9f7f-e16078ed53a0 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092956 Jul 02 03:36:04.749333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 116/219] 10.222.0.42 () {58 vars in 1166 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:36:04.762146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b3e330e0-314d-4a8a-8e5c-9ab4037e8830 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c076940>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.846318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b3e330e0-314d-4a8a-8e5c-9ab4037e8830 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088356 Jul 02 03:36:04.846899 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 104/220] 10.222.0.42 () {58 vars in 1169 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:36:04.861916 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8062a46e-652b-41bd-84ed-52614341cef7 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c079ee0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.923179 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:04.923825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:04.930606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:04.931061 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:04.931858 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:04.932298 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:04.943678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8062a46e-652b-41bd-84ed-52614341cef7 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085414 Jul 02 03:36:04.944254 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 117/221] 10.222.0.42 () {58 vars in 1154 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:04.956371 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b62b725c-4224-4fa4-9687-c6ea0baa456c tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c017af0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:05.069745 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:05.078495 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-80f24f4a-6f38-4f2d-81f0-5b640a16b289 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.159365 Jul 02 03:36:05.079070 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 105/222] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:05.202192 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b62b725c-4224-4fa4-9687-c6ea0baa456c tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.250061 Jul 02 03:36:05.202949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 118/223] 10.222.0.42 () {58 vars in 1187 bytes} [Sat Jul 2 03:36:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:36:05.214860 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-45d150b3-a00e-456f-b62d-44920d1e5825 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] Calling method '.version_select at 0x7f2e9c060f70>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:05.293674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-45d150b3-a00e-456f-b62d-44920d1e5825 tempest-VolumesTestJSON-1324238820 tempest-VolumesTestJSON-1324238820-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082749 Jul 02 03:36:05.294238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 106/224] 10.222.0.42 () {58 vars in 1154 bytes} [Sat Jul 2 03:36:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:06.099993 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:06.100909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:06.112708 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:06.113447 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:06.114787 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:06.115213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:06.266463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:06.274677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c670e5a7-bb01-4c65-b66f-a919be51f7a1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.181388 Jul 02 03:36:06.275271 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 119/225] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:06 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:07.306288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:07.307539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:07.318471 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:07.318646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:07.319457 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:07.319893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:07.461026 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:07.468758 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-12f45421-4171-488d-87ce-e27e0f1c9581 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.174809 Jul 02 03:36:07.469360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 107/226] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:07 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:08.489411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:08.490419 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:08.497221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:08.497670 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:08.498440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:08.498867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:08.635119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:08.642604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-addd0e37-f2cd-4723-9fb3-35eaf4753d3a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.159652 Jul 02 03:36:08.643176 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 120/227] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:08 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:09.662830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:09.663444 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:09.670544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:09.671003 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:09.671819 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:09.672258 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:09.813317 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:09.825722 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-68c555fd-77ec-4f0e-bdb8-ea50753274b4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.168345 Jul 02 03:36:09.826571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 108/228] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:09 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:10.847102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:10.848145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:10.855436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:10.855878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:10.856646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:10.857081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:10.993467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:11.001178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-23582476-7986-4006-aa60-5ff0e09ff14e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.160469 Jul 02 03:36:11.001739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 121/229] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:10 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:12.003362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1093982348", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-909464848", "security_groups": [{"name": "tempest-secgroup-smoke-1563014043"}], "networks": [{"uuid": "b173f876-9c4f-4325-a46d-ef7a6e505875"}], "block_device_mapping_v2": [{"uuid": "b80f13eb-c845-4c52-8d83-7b9fbe6317c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:12.019159 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:12.020470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:12.027286 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:12.027771 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:12.028615 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:12.028984 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:12.164008 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] validate_networks() for [('b173f876-9c4f-4325-a46d-ef7a6e505875', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:36:12.226802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:12.235904 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2b8a282e-be25-496e-82e4-7f82ae777bd9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.221540 Jul 02 03:36:12.236747 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 122/230] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:12 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:12.576216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:36:12.576639 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:36:12.577110 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:36:12.577517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:36:12.577926 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:36:12.587831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:12.588281 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:12.589091 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:12.589531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:12.596562 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=83 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:12.608206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Getting quotas for project 6c04290d87154e48a3bf77a828b563ba. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:36:12.612144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Getting quotas for user 4f509b8a8e3c4bc3a5143d44c078d939 and project 6c04290d87154e48a3bf77a828b563ba. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:36:12.669120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:36:12.672256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b80f13eb-c845-4c52-8d83-7b9fbe6317c8',volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:36:12.807542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cf93803b-5405-4041-9ba8-76b96d84a83e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809587 Jul 02 03:36:12.808488 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 109/231] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:36:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:36:12.818351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e7ce561d-2ca1-4ef3-b659-cb89c0efe7ee tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:12.819141 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e7ce561d-2ca1-4ef3-b659-cb89c0efe7ee tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:12.883573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e7ce561d-2ca1-4ef3-b659-cb89c0efe7ee tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:12.892123 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e7ce561d-2ca1-4ef3-b659-cb89c0efe7ee tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1088 microversion: 2.1 time: 0.077514 Jul 02 03:36:12.893686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 123/232] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:12 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:13.253291 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:13.253893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:13.261525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:13.261978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:13.262776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:13.263306 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:13.402409 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:13.409986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-10cabf73-bad8-4c34-8eaf-670193799c89 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.161366 Jul 02 03:36:13.410762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 110/233] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:13 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:13.910019 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:13.910626 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:13.912486 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=32 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:13.918122 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:13.918566 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:13.919687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:13.920120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:13.983323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:13.991202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4bddf981-9a0f-40e9-b048-55ce5ada03b2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1138 microversion: 2.1 time: 0.085102 Jul 02 03:36:13.992067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 124/234] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:13 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:14.428302 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:14.429278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:14.436860 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:14.437323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:14.438116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:14.438560 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:14.576387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:14.586333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8d69d92d-4fec-44e1-90e9-1579f750336e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.162174 Jul 02 03:36:14.587115 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 111/235] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:14 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:15.008538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:15.010952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:15.019541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:15.020366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:15.021390 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:15.022091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:15.088294 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:15.096147 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1ce7b28e-2940-40f6-91dd-6eb070a73994 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1138 microversion: 2.1 time: 0.092096 Jul 02 03:36:15.096754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 125/236] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:15 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:15.607770 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:15.608573 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:15.619540 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:15.620279 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:15.621525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:15.622273 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:15.774936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:15.782925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7f4cfd65-6c85-4029-8cb7-cdf3871c0ac3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.181981 Jul 02 03:36:15.783532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 112/237] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:15 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:16.119442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:16.120062 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:16.126701 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:16.127149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:16.127940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:16.128377 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:16.193759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:16.201673 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ceda2796-edfa-4362-955e-00623851c802 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1138 microversion: 2.1 time: 0.092256 Jul 02 03:36:16.202227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 126/238] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:16 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:16.805130 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:16.806708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:16.817187 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:16.817937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:16.819191 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:16.819972 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:16.955266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:16.963776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2ce7e4d9-4338-444d-acde-220103cf0e38 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.165186 Jul 02 03:36:16.964363 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 113/239] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:16 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:17.219446 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:17.220286 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:17.228310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:17.228761 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:17.229527 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:17.229967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:17.291112 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:17.299037 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c0449013-022f-43b8-ab97-38fd255a111e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1186 microversion: 2.1 time: 0.084191 Jul 02 03:36:17.299672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 127/240] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:17 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:17.981943 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:17.982576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:17.989829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:17.990296 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:17.991096 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:17.991588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:18.134216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:18.142126 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9f936b21-fd56-4e14-beb0-f45692a49a30 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.164372 Jul 02 03:36:18.142687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 114/241] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:17 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:18.317055 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:18.317763 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:18.323945 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:18.324383 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:18.325327 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:18.325912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:18.399356 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:18.415010 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-29a44024-80f6-4c51-9895-5b8ab514bc1a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1186 microversion: 2.1 time: 0.096622 Jul 02 03:36:18.416265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 128/242] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:18 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:19.158994 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:19.159639 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:19.166541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:19.166984 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:19.167788 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:19.168229 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:19.302925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:19.310653 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4296f8a1-207a-435b-98b5-3a2ed4a70c3f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.155538 Jul 02 03:36:19.311316 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 115/243] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:19 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:19.433494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:19.434188 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:19.440541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:19.441120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:19.442001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:19.442543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:19.508008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:19.522678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5a1d7a99-4e76-4e86-9874-c7a6d5e49247 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1186 microversion: 2.1 time: 0.086999 Jul 02 03:36:19.522678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 129/244] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:19 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:19.723907 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ea8cc601-dbff-4448-bd63-ae1a64fe60b8 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Action: 'create', calling method: .version_select at 0x7f2e9c0638b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2138278809", "metadata": {"Type": "work"}}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ea8cc601-dbff-4448-bd63-ae1a64fe60b8 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Request method failure captured: Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 122 Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv70zlfv0xPKuk3_0xlam2mXDf8h_-tF7jWX0soH1QK6lVinnqtefGQG9-6LYbcu5rZny2XKbeaF9-XwZI6Ij8FGq091GuZsI3IevWb_YIGpBDRuIuAe-i9sOhcW4urwy1qW0ElpkoYX0XO2fNEFDE6ZAH7YQmru_dvtC1Uqc-r7NK_k Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:36:19.745391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b791a494c7c442269d567f72e37f03ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 3ac45addb60a407f92321a5da9b47144 Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2138278809", "metadata": {"Type": "work"}}} Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: Jul 02 03:36:19.746884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2138278809', 'metadata': {'Type': 'work'}}}} Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise error Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi '#$%' Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:36:19.752325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 03:36:19.753783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 03:36:19.755511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 02 03:36:19.755511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.755511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ea8cc601-dbff-4448-bd63-ae1a64fe60b8 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:36:19.755511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ea8cc601-dbff-4448-bd63-ae1a64fe60b8 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.152182 Jul 02 03:36:19.755511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 116/245] 10.222.0.42 () {60 vars in 1155 bytes} [Sat Jul 2 03:36:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:36:19.756955 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-26c62530-81d6-4be0-bf92-d3490e597e17 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Action: 'create', calling method: .version_select at 0x7f2e9c084280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-837336133", "metadata": {"Type": "work"}}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-26c62530-81d6-4be0-bf92-d3490e597e17 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Request method failure captured: Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 119 Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv70zlfv0xPKuk3_0xlam2mXDf8h_-tF7jWX0soH1QK6lVinnqtefGQG9-6LYbcu5rZny2XKbeaF9-XwZI6Ij8FGq091GuZsI3IevWb_YIGpBDRuIuAe-i9sOhcW4urwy1qW0ElpkoYX0XO2fNEFDE6ZAH7YQmru_dvtC1Uqc-r7NK_k Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:36:19.760545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b791a494c7c442269d567f72e37f03ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 3ac45addb60a407f92321a5da9b47144 Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-837336133", "metadata": {"Type": "work"}}} Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: Jul 02 03:36:19.761755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-837336133', 'metadata': {'Type': 'work'}}}} Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise error Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi '0' Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:36:19.762467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 03:36:19.767738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 03:36:19.769440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 02 03:36:19.769440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.769440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-26c62530-81d6-4be0-bf92-d3490e597e17 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:36:19.769440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-26c62530-81d6-4be0-bf92-d3490e597e17 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008788 Jul 02 03:36:19.769440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 130/246] 10.222.0.42 () {60 vars in 1155 bytes} [Sat Jul 2 03:36:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 02 03:36:19.772687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d33d4b5e-9e6d-4fbf-bb13-5efe47ad3b8c tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Action: 'create', calling method: .version_select at 0x7f2e9c060b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1916819843", "metadata": {"Type": "work"}}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d33d4b5e-9e6d-4fbf-bb13-5efe47ad3b8c tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Request method failure captured: Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 119 Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv70zlfv0xPKuk3_0xlam2mXDf8h_-tF7jWX0soH1QK6lVinnqtefGQG9-6LYbcu5rZny2XKbeaF9-XwZI6Ij8FGq091GuZsI3IevWb_YIGpBDRuIuAe-i9sOhcW4urwy1qW0ElpkoYX0XO2fNEFDE6ZAH7YQmru_dvtC1Uqc-r7NK_k Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:36:19.775887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b791a494c7c442269d567f72e37f03ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 3ac45addb60a407f92321a5da9b47144 Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1916819843", "metadata": {"Type": "work"}}} Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: Jul 02 03:36:19.777366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1916819843', 'metadata': {'Type': 'work'}}}} Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise error Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi '' Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:36:19.778079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 03:36:19.779520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 03:36:19.780660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 02 03:36:19.780660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.780660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d33d4b5e-9e6d-4fbf-bb13-5efe47ad3b8c tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:36:19.780660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d33d4b5e-9e6d-4fbf-bb13-5efe47ad3b8c tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008579 Jul 02 03:36:19.780660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 117/247] 10.222.0.42 () {60 vars in 1155 bytes} [Sat Jul 2 03:36:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:36:19.787422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4d2956b4-53f7-4f30-b2ea-79fab5f8603d tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Calling method '.version_select at 0x7f2e9c0170d0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:19.819341 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-4d2956b4-53f7-4f30-b2ea-79fab5f8603d tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] HTTP exception thrown: Volume tempest-invalid-1119329021 could not be found. Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4d2956b4-53f7-4f30-b2ea-79fab5f8603d tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Request method failure captured: Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1119329021 HTTP/1.1 Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv70zlfv0xPKuk3_0xlam2mXDf8h_-tF7jWX0soH1QK6lVinnqtefGQG9-6LYbcu5rZny2XKbeaF9-XwZI6Ij8FGq091GuZsI3IevWb_YIGpBDRuIuAe-i9sOhcW4urwy1qW0ElpkoYX0XO2fNEFDE6ZAH7YQmru_dvtC1Uqc-r7NK_k Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:36:19.823276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b791a494c7c442269d567f72e37f03ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 3ac45addb60a407f92321a5da9b47144 Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Volume tempest-invalid-1119329021 could not be found. Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'tempest-invalid-1119329021'} Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:36:19.824745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1119329021 could not be found. (HTTP 404) (Request-ID: req-7a475cef-964e-4d6f-a083-a58ef8ffea65) Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.826086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 03:36:19.827533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1119329021 could not be found. Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:36:19.828853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1119329021 could not be found. Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1119329021 could not be found. Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4d2956b4-53f7-4f30-b2ea-79fab5f8603d tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Returning 404 to user: Volume tempest-invalid-1119329021 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:36:19.830329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4d2956b4-53f7-4f30-b2ea-79fab5f8603d tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1119329021" status: 404 len: 99 microversion: 2.1 time: 0.042324 Jul 02 03:36:19.837586 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-662759da-30a0-491e-833a-4da2edf783cb tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004801 Jul 02 03:36:19.838079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 118/248] 10.222.0.42 () {58 vars in 1139 bytes} [Sat Jul 2 03:36:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 02 03:36:19.841651 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 131/249] 10.222.0.42 () {58 vars in 1217 bytes} [Sat Jul 2 03:36:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1119329021 => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 03:36:19.846219 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b02ec7f6-8cc1-4173-b15f-63a73c788e5f tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003498 Jul 02 03:36:19.846748 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 119/250] 10.222.0.42 () {58 vars in 1136 bytes} [Sat Jul 2 03:36:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 02 03:36:19.856597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2d1e86de-6522-44b3-b21e-eea26b932e95 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Calling method '.version_select at 0x7f2e9c017430>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:19.886992 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-2d1e86de-6522-44b3-b21e-eea26b932e95 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] HTTP exception thrown: Volume 510142d4-b5ba-4266-80c3-4627ee11e352 could not be found. Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2d1e86de-6522-44b3-b21e-eea26b932e95 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Request method failure captured: Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/os-volumes/510142d4-b5ba-4266-80c3-4627ee11e352 HTTP/1.1 Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv70zlfv0xPKuk3_0xlam2mXDf8h_-tF7jWX0soH1QK6lVinnqtefGQG9-6LYbcu5rZny2XKbeaF9-XwZI6Ij8FGq091GuZsI3IevWb_YIGpBDRuIuAe-i9sOhcW4urwy1qW0ElpkoYX0XO2fNEFDE6ZAH7YQmru_dvtC1Uqc-r7NK_k Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:36:19.890919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b791a494c7c442269d567f72e37f03ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 3ac45addb60a407f92321a5da9b47144 Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Volume 510142d4-b5ba-4266-80c3-4627ee11e352 could not be found. Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '510142d4-b5ba-4266-80c3-4627ee11e352'} Jul 02 03:36:19.892145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 510142d4-b5ba-4266-80c3-4627ee11e352 could not be found. (HTTP 404) (Request-ID: req-1a72ca09-52b3-4f2a-a688-da51e722f70e) Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.892879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 03:36:19.894655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 510142d4-b5ba-4266-80c3-4627ee11e352 could not be found. Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 02 03:36:19.895817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 510142d4-b5ba-4266-80c3-4627ee11e352 could not be found. Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 510142d4-b5ba-4266-80c3-4627ee11e352 could not be found. Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2d1e86de-6522-44b3-b21e-eea26b932e95 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Returning 404 to user: Volume 510142d4-b5ba-4266-80c3-4627ee11e352 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2d1e86de-6522-44b3-b21e-eea26b932e95 tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/510142d4-b5ba-4266-80c3-4627ee11e352" status: 404 len: 109 microversion: 2.1 time: 0.039487 Jul 02 03:36:19.896989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 132/251] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:36:19 2022] DELETE /compute/v2.1/os-volumes/510142d4-b5ba-4266-80c3-4627ee11e352 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 03:36:19.900607 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3fed3c1a-2d31-4079-ad5f-d9d47628211e tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Calling method '.version_select at 0x7f2e9c1e9ee0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:19.931512 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-3fed3c1a-2d31-4079-ad5f-d9d47628211e tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] HTTP exception thrown: Volume 630ade9b-5a56-4ed6-b4e9-ed5532a154cd could not be found. Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3fed3c1a-2d31-4079-ad5f-d9d47628211e tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Request method failure captured: Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/os-volumes/630ade9b-5a56-4ed6-b4e9-ed5532a154cd HTTP/1.1 Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv70zlfv0xPKuk3_0xlam2mXDf8h_-tF7jWX0soH1QK6lVinnqtefGQG9-6LYbcu5rZny2XKbeaF9-XwZI6Ij8FGq091GuZsI3IevWb_YIGpBDRuIuAe-i9sOhcW4urwy1qW0ElpkoYX0XO2fNEFDE6ZAH7YQmru_dvtC1Uqc-r7NK_k Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:36:19.934919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b791a494c7c442269d567f72e37f03ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b791a494c7c442269d567f72e37f03ca", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b791a494c7c442269d567f72e37f03ca Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesNegativeTest-27086303 Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 3ac45addb60a407f92321a5da9b47144 Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesNegativeTest-27086303-project Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Volume 630ade9b-5a56-4ed6-b4e9-ed5532a154cd could not be found. Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '630ade9b-5a56-4ed6-b4e9-ed5532a154cd'} Jul 02 03:36:19.936369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 630ade9b-5a56-4ed6-b4e9-ed5532a154cd could not be found. (HTTP 404) (Request-ID: req-fa90ee67-5569-4ee1-8258-a2292eebb4ac) Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.937234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:36:19.938549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 630ade9b-5a56-4ed6-b4e9-ed5532a154cd could not be found. Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 03:36:19.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 630ade9b-5a56-4ed6-b4e9-ed5532a154cd could not be found. Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 630ade9b-5a56-4ed6-b4e9-ed5532a154cd could not be found. Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3fed3c1a-2d31-4079-ad5f-d9d47628211e tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] Returning 404 to user: Volume 630ade9b-5a56-4ed6-b4e9-ed5532a154cd could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3fed3c1a-2d31-4079-ad5f-d9d47628211e tempest-VolumesNegativeTest-27086303 tempest-VolumesNegativeTest-27086303-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/630ade9b-5a56-4ed6-b4e9-ed5532a154cd" status: 404 len: 109 microversion: 2.1 time: 0.039780 Jul 02 03:36:19.941019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 120/252] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:36:19 2022] GET /compute/v2.1/os-volumes/630ade9b-5a56-4ed6-b4e9-ed5532a154cd => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 03:36:20.327783 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:20.329118 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:20.336744 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:20.337191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:20.337970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:20.338519 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:20.342805 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=96 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:20.533967 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:20.534519 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:20.541536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:20.541899 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:20.542676 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:20.543095 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:20.543938 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:20.554597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e4fc83d9-83e5-4234-a77c-13f7807c02a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.230792 Jul 02 03:36:20.563883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 133/253] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:20 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:20.614104 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:20.620986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-59cc3864-755e-41d5-b42d-5e9d770d6d91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1186 microversion: 2.1 time: 0.091662 Jul 02 03:36:20.621778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 121/254] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:20 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:21.570689 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:21.571447 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:21.577580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:21.578101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:21.578974 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:21.579545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:21.639144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:21.639961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:21.646448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:21.646892 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:21.647697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:21.648128 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:21.725951 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:21.735286 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e7871d2d-446a-46c6-acbb-fc42c37f11e4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1194 microversion: 2.1 time: 0.101165 Jul 02 03:36:21.735852 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 122/255] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:21 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:21.748820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:21.757196 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8f73cd8d-8e93-4a12-a83f-72e03fad2825 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.190386 Jul 02 03:36:21.757759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 134/256] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:21 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:22.752965 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:22.753705 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:22.755887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:22.756846 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:22.763794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:22.764331 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:22.765042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:22.765465 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:22.774124 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:22.774973 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:22.782356 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:22.782958 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:22.783852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:22.784508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:22.833256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:22.841694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3c22bdf7-f042-40fa-b128-e9d2e6db6293 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1204 microversion: 2.1 time: 0.092719 Jul 02 03:36:22.842380 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 123/257] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:22 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:22.889046 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:22.932221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:22.939798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ff7297b9-444c-4861-a1ee-508097c19ea1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.169516 Jul 02 03:36:22.940383 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 135/258] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:22 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:23.859844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:23.860729 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:23.875070 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:23.875684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:23.876712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:23.877153 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:23.958730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:23.960442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:23.971002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:23.973815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:23.974631 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:23.976195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:23.978858 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:23.980446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b889fa3e-a005-4c65-9883-59dd474a99b9 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1204 microversion: 2.1 time: 0.124948 Jul 02 03:36:23.988438 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 124/259] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:23 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1204 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:24.209635 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:24.223772 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6dcd833f-bb94-4b23-82f0-37ff1f6dc43d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1521 microversion: 2.1 time: 0.269991 Jul 02 03:36:24.227053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 136/260] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:23 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:25.000802 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:25.006717 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:25.017295 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:25.018057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:25.019162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:25.020220 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:25.242282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:25.245293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:25.245949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:25.252015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f8930139-53e8-400d-b06a-30ee46ffb28f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.257744 Jul 02 03:36:25.252432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:25.252878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:25.253813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:25.254435 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:25.254965 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 125/261] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:24 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:25.442769 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:25.453772 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f87c53cc-59f0-463a-b92d-637a0a6154c1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1501 microversion: 2.1 time: 0.212852 Jul 02 03:36:25.455993 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 137/262] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:25 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:25.476958 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:25.477692 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:25.485457 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:25.489865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:25.490694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:25.493961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:25.496498 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:25.750962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:25.763042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4a9a13f2-4a9c-4530-9073-8b674a8048b6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1514 microversion: 2.1 time: 0.288292 Jul 02 03:36:25.765919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 126/263] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:25 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:26.078795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-78d99358-e1f8-4f61-a694-24c4afb8186f req-d800e606-b1c2-4967-aefc-fa190fe3bb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c09baf3-acd2-45b3-bce4-9fd6b31efdac", "tag": "e19a69f0-6e0d-4a86-85f9-02d1861bdf96"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:26.092982 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-78d99358-e1f8-4f61-a694-24c4afb8186f req-d800e606-b1c2-4967-aefc-fa190fe3bb10 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:26.093357 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-78d99358-e1f8-4f61-a694-24c4afb8186f req-d800e606-b1c2-4967-aefc-fa190fe3bb10 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:26.113560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-78d99358-e1f8-4f61-a694-24c4afb8186f req-d800e606-b1c2-4967-aefc-fa190fe3bb10 service nova] Creating event network-changed:e19a69f0-6e0d-4a86-85f9-02d1861bdf96 for instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac on hv-cinder-84684 Jul 02 03:36:26.118892 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-78d99358-e1f8-4f61-a694-24c4afb8186f req-d800e606-b1c2-4967-aefc-fa190fe3bb10 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045385 Jul 02 03:36:26.120027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 138/264] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:36:26.274673 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:26.274673 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:26.282015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:26.283137 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:26.284045 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:26.284998 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:26.441173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:26.449059 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-285ee0be-e6c5-4739-a326-5b6e2d87293f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.181655 Jul 02 03:36:26.451324 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 127/265] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:26 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:27.466751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:27.467500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:27.473831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:27.474275 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:27.475025 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:27.475548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:27.648613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:27.659201 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5576dfb5-c8c9-43ae-9ae6-76e7dbcc3a8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.196419 Jul 02 03:36:27.660042 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 139/266] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:27 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:28.375531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:28.376562 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:28.392022 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:28.392698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:28.393578 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:28.394118 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:28.425083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lazy-loading 'flavor' on Instance uuid 7dee71eb-cb9f-458e-96b2-4f6db8156153 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:36:28.562089 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-bb1053bb-cc57-48ab-a61e-e5a518881eb7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153/action" status: 200 len: 32 microversion: 2.1 time: 0.189944 Jul 02 03:36:28.563009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 128/267] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:36:28 2022] POST /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:36:28.571919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:28.572525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:28.579143 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:28.579751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:28.580672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:28.581111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:28.676732 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:28.677431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:28.686056 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:28.686607 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:28.687621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:28.688206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:28.706321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:28.724104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:28.733036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2e6090e5-b618-4393-af1e-62f4a317ecde tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.164969 Jul 02 03:36:28.735368 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 140/268] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:28 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:28.831359 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:28.839325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9fc42d39-2428-47cc-b80b-6642d024195c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.166628 Jul 02 03:36:28.843455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 129/269] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:28 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:29.753134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:29.753780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:29.761878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:29.762323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:29.763079 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:29.763547 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:29.857064 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:29.857650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:29.864045 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:29.864496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:29.865259 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:29.865696 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:29.917872 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:29.926073 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e6b854be-f725-402f-b4ee-b2a50e51af25 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.179028 Jul 02 03:36:29.926679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 141/270] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:29 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:30.004670 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:30.017083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-26371667-ef4f-4715-9d36-d8ba95c3db0e tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.163841 Jul 02 03:36:30.017637 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 130/271] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:29 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:30.943620 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:30.944212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:30.950759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:30.951203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:30.951983 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:30.952412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:31.034054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:31.034668 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:31.041749 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:31.042204 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:31.042963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:31.043428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:31.085080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:31.092915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5cd0a38a-06ad-4c12-a728-ac0848d6e97f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.153244 Jul 02 03:36:31.093473 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 142/272] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:30 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:31.190577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:31.199269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-679a6364-32cb-46fd-82da-7d3b3a948e49 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.169032 Jul 02 03:36:31.200064 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 131/273] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:31 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:32.112789 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:32.113367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:32.124549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:32.125075 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:32.125863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:32.126262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:32.216201 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:32.216889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:32.223522 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:32.224289 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:32.225113 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:32.225609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:32.266687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:32.275693 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d45a578e-d3e6-448b-a1d5-a429059b9f61 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.168614 Jul 02 03:36:32.276286 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 143/274] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:32 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:32.505875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:32.513986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5a999f65-7dcd-4dc4-85fc-5d6ce17d0ac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.301669 Jul 02 03:36:32.514547 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 132/275] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:32 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:33.293101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:33.294724 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:33.301158 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:33.301589 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:33.302432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:33.302882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:33.432263 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:33.439726 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e0676245-3afc-40af-8727-a168f186ff1e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.150591 Jul 02 03:36:33.440328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 144/276] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:33 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:33.531152 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:33.531926 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:33.538570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:33.539014 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:33.539818 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:33.540256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:33.691091 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:33.699180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f3bad62c-b481-4f3d-b3c1-003264ece689 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.172103 Jul 02 03:36:33.699779 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 133/277] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:33 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:34.457618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:34.458184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:34.464643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:34.465098 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:34.465866 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:34.466315 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:34.602150 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:34.610237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a9e3bf61-9fb3-4770-acb4-63b4af5b6c4e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.156922 Jul 02 03:36:34.610864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 145/278] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:34 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:34.716627 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:34.717544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:34.723926 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:34.724584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:34.725429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:34.725859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:34.882592 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:34.890955 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d146e122-f554-4210-abbe-51c4c252ca59 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.178717 Jul 02 03:36:34.892070 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 134/279] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:34 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:35.627893 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:35.628499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:35.635745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:35.636198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:35.636968 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:35.637392 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:35.778632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:35.786384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-43790635-d95e-4547-96a2-1a4d56967013 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.162620 Jul 02 03:36:35.786952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 146/280] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:35 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:35.911715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:35.912746 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:35.924062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:35.924811 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:35.926174 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:35.927046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:36.067758 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:36.075533 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ae6d1f2d-7fa8-4738-a514-59bb28dc1b82 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.170455 Jul 02 03:36:36.076117 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 135/281] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:35 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:36.808530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:36.809266 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:36.815624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:36.816058 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:36.816819 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:36.817245 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:36.959184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:36.972011 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d14b9874-3c24-47dd-b239-27576170fa02 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.169834 Jul 02 03:36:36.972802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 147/282] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:36 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:37.093660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:37.094298 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:37.104645 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:37.105125 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:37.106055 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:37.106455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:37.245362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:37.253194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-368458d0-5451-4e35-8fc3-b4e4ae63a27f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.164464 Jul 02 03:36:37.253779 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 136/283] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:37 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:37.996487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:37.997298 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:38.006955 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:38.007572 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:38.008641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:38.009165 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:38.139897 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:38.147871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7242ea12-62c2-448f-8cd6-353607629046 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.157900 Jul 02 03:36:38.148436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 148/284] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:37 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:38.270631 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:38.271263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:38.278209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:38.278986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:38.279826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:38.280323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:38.415711 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:38.423816 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6c228bc3-b07c-4279-b91a-fd0418af893c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.157183 Jul 02 03:36:38.424402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 137/285] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:38 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:39.164946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:39.166071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:39.173088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:39.173819 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:39.174600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:39.175039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:39.309910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:39.317457 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8942ec26-32cd-457a-a885-93275f6b6e69 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.156302 Jul 02 03:36:39.318017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 149/286] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:39 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:39.441336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:39.441980 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:39.448842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:39.449288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:39.450074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:39.450578 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:39.595067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:39.604965 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-90e6f6bc-43e5-47b1-97f5-1050393faea8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.167418 Jul 02 03:36:39.605751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 138/287] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:39 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:40.338057 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:40.338700 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:40.345448 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:40.345897 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:40.346677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:40.347108 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:40.364525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:40.491225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:40.499070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0d9cb099-55fd-4b61-a658-a25b534ca571 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.164863 Jul 02 03:36:40.499657 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 150/288] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:40 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:40.623658 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:40.624870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:40.632377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:40.632981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:40.633917 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:40.634595 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:41.062927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:41.074370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ebd5d964-690c-4561-bb77-1d120f4cfbc7 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.454971 Jul 02 03:36:41.074958 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 139/289] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:40 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:41.516125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:41.516730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:41.523069 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:41.523638 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:41.524422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:41.524849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:41.664676 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:41.677059 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-58bf8275-177a-484d-89d5-405488168f57 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.164579 Jul 02 03:36:41.689607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 151/290] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:41 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:42.092715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:42.093589 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:42.100613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:42.101275 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:42.102151 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:42.102844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:42.280252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:42.293243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e630152a-cf0d-4179-8b9b-a1a9263fcf91 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.204767 Jul 02 03:36:42.302840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 140/291] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:42 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:42.696400 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:42.697142 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:42.703764 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:42.704219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:42.705134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:42.705599 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:42.841157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:42.849139 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-81b9820c-89dd-4f36-8a24-ef4780e182f0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.156526 Jul 02 03:36:42.849755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 152/292] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:42 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:43.310160 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:43.310997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:43.317932 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:43.318384 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:43.319173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:43.319638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:43.463912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:43.472223 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-71b2e063-be02-49d9-b269-811915fdc758 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.166005 Jul 02 03:36:43.472793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 141/293] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:43 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:43.870205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:43.871204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:43.881492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:43.882209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:43.883556 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:43.884286 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:44.030982 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:44.038656 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5805156c-cdc4-4b41-823b-19813aea50a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.174994 Jul 02 03:36:44.039194 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 153/294] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:43 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:44.493284 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:44.494279 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:44.505438 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:44.506176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:44.507489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:44.508246 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:44.650404 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:44.661965 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ac22a537-27cb-4b03-96a9-03b959fadc2b tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.174901 Jul 02 03:36:44.662808 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 142/295] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:44 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:45.058111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:45.058910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:45.061392 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=54 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:45.067258 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:45.067730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:45.068561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:45.068984 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:45.206389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:45.214563 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b909ad25-27ed-4a70-9818-f7219cc5f9ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.161655 Jul 02 03:36:45.215327 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 154/296] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:45 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:45.680033 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:45.680619 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:45.687963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:45.688419 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:45.689163 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:45.689609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:45.836357 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:45.847188 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-923d0127-0551-4955-a85c-8655d74ef969 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.171282 Jul 02 03:36:45.847816 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 143/297] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:45 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:46.234776 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:46.235592 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:46.243544 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:46.243996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:46.244765 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:46.245189 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:46.381975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:46.399488 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fe840cd6-4a7e-42b2-a586-0e88c46d5e6e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.169848 Jul 02 03:36:46.400402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 155/298] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:46 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:46.423593 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-e6cd6c90-d802-45cb-b6cf-bdc486d03753 req-67e54d9f-7185-491b-bcbb-33841ce20d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c09baf3-acd2-45b3-bce4-9fd6b31efdac", "name": "network-vif-plugged", "status": "completed", "tag": "e19a69f0-6e0d-4a86-85f9-02d1861bdf96"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:46.431791 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-e6cd6c90-d802-45cb-b6cf-bdc486d03753 req-67e54d9f-7185-491b-bcbb-33841ce20d68 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:46.432236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-e6cd6c90-d802-45cb-b6cf-bdc486d03753 req-67e54d9f-7185-491b-bcbb-33841ce20d68 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:46.445639 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-e6cd6c90-d802-45cb-b6cf-bdc486d03753 req-67e54d9f-7185-491b-bcbb-33841ce20d68 service nova] Creating event network-vif-plugged:e19a69f0-6e0d-4a86-85f9-02d1861bdf96 for instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac on hv-cinder-84684 Jul 02 03:36:46.450730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-e6cd6c90-d802-45cb-b6cf-bdc486d03753 req-67e54d9f-7185-491b-bcbb-33841ce20d68 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031418 Jul 02 03:36:46.451663 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 144/299] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:36:46.868156 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:46.869249 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:46.879608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:46.880349 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:46.881592 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:46.882347 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:47.027542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:47.036608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-81b67b30-0b80-4fa2-82c0-523cd2051fad tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.174850 Jul 02 03:36:47.037170 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 156/300] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:46 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:47.417034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:47.417761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:47.425613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:47.426060 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:47.426936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:47.427531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:47.431716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2075587828", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "networks": [{"uuid": "7e34743c-39b1-41c2-b662-fc644b4f04d0"}]}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:47.486432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] validate_networks() for [('7e34743c-39b1-41c2-b662-fc644b4f04d0', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:36:47.646491 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:47.655826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-372786fb-aa40-4164-9505-f5ff8f436c85 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.242485 Jul 02 03:36:47.656527 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 145/301] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:47 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:47.917368 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:36:47.917958 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:36:47.918647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:36:47.925203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:36:47.925746 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:36:47.939452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:47.940012 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:47.940894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:47.941323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:47.958641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Getting quotas for project 81a1413099324b758a2608fa5d67c0a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:36:47.962967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Getting quotas for user 662efed3aab046bfb378bbffc49a9c11 and project 81a1413099324b758a2608fa5d67c0a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:36:47.975178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:36:47.977616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:36:48.034999 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-db4d51f3-a1cc-4438-91f1-bf9b59caefcc tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607172 Jul 02 03:36:48.035680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 157/302] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:36:48.046251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8740acf4-af19-4a63-98b8-b9b78a7dd080 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:48.046864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8740acf4-af19-4a63-98b8-b9b78a7dd080 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:48.054991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:48.055945 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:48.061936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:48.062407 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:48.063317 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:48.063694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:48.104591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8740acf4-af19-4a63-98b8-b9b78a7dd080 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:48.120295 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8740acf4-af19-4a63-98b8-b9b78a7dd080 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1214 microversion: 2.1 time: 0.078262 Jul 02 03:36:48.120871 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 146/303] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:48 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:48.205512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:48.213623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ce648bd5-ec11-47d6-8209-df599ce4ec5c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.163751 Jul 02 03:36:48.214178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 158/304] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:48 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:48.678213 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:48.679072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:48.689146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:48.689599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:48.690402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:48.690835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:48.832698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:48.835422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:48.842652 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cd338350-8024-4a58-8ea0-aa808a9587b5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.170997 Jul 02 03:36:48.843221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 147/305] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:48 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:49.137160 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:49.137775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:49.144510 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:49.144965 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:49.145721 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:49.146146 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:49.213128 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:49.221764 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-aed6b770-1d79-4b22-a0fa-7051fa939da3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1218 microversion: 2.1 time: 0.088533 Jul 02 03:36:49.222271 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 159/306] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:49 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:49.230571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:49.231780 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:49.239058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:49.239532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:49.240323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:49.240755 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:49.385906 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:49.395269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ed55ea0b-63c1-4c8a-9062-82d5fc784e8d tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.168766 Jul 02 03:36:49.396078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 148/307] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:49 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:49.860696 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:49.861561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:49.868437 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:49.868887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:49.869705 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:49.870389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:50.006114 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:50.013998 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c2feab93-0ecf-4379-a3bf-a23354dd7e86 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.157931 Jul 02 03:36:50.015473 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 160/308] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:49 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:50.246538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:50.247197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:50.253967 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:50.254415 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:50.255189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:50.255651 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:50.316600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:50.324856 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c2bc3f63-a20f-4808-ab06-32385b9fdfe4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1266 microversion: 2.1 time: 0.090806 Jul 02 03:36:50.325412 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 149/309] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:50 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:50.419983 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:50.421690 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:50.428134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:50.428635 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:50.429443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:50.429933 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:50.575130 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:50.583732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-962ae03f-ca1e-4560-bf7b-e6907973ec07 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1260 microversion: 2.1 time: 0.169915 Jul 02 03:36:50.584292 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 161/310] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:50 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:51.033210 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:51.033826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:51.040451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.040902 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.041773 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.042211 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.181739 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:51.190059 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-619eb37c-c57b-4129-9416-f948fbbca5a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.161733 Jul 02 03:36:51.190606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 150/311] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:51 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:51.341861 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:51.342470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:51.349316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.349773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.350447 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.350878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.417782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:51.431091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ab1b1871-df10-4392-81db-5c92820edea5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1266 microversion: 2.1 time: 0.092729 Jul 02 03:36:51.432120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 162/312] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:51 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:51.601102 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:51.601716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:51.608067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.608577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.609709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.610149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.774190 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:51.782145 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d2790282-fccd-4b04-8d4c-4569fa3e68ba tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1443 microversion: 2.1 time: 0.184837 Jul 02 03:36:51.782716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 151/313] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:51 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1443 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:51.800209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:51.800780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:51.807568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.808397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.809283 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:51.809794 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:51.984074 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:51.991697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a88325c0-4fe4-4dcb-8905-32746a178907 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1443 microversion: 2.1 time: 0.196381 Jul 02 03:36:51.992253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 163/314] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:51 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1443 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:52.208170 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:52.209181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:52.224694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.225525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.227884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.228471 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.450621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:52.451389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:52.457963 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.458520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.459533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.460068 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.481068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:52.488750 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a84683c3-2f1e-4c16-b893-09d86b320346 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1500 microversion: 2.1 time: 0.285398 Jul 02 03:36:52.489333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 152/315] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:52 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1500 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:52.506598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fef695ba-35cd-45f0-afb7-23d468dca125"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:52.507931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:52.514370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.514773 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.515612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.516051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.541792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] HTTP exception thrown: Cannot 'attach_volume' instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 while it is in vm_state rescued Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Request method failure captured: Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: POST /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153/os-volume_attachments HTTP/1.1 Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 74 Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7y7bLzPUWFj-NGZjnUbomMq9pCCamrIuGlzdL46FEgS4ugkab4y2M6CbytxBUL8dkybAU6gDY9bUrXa1zy9U6WD5wxDq1C1uLmIU9sloFjK6V5E4AaTr6XlcaOHNRqXcACZxcYpwgyaccNXlLlp85hntILkHdL5-bxVYphqZoabe4w Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:36:52.543698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53c88ba2f03f47538ca0eaeb08ccfc07", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: c941dc00e0584666aba13263b8c1fcb8 Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {"volumeAttachment": {"volumeId": "fef695ba-35cd-45f0-afb7-23d468dca125"}} Jul 02 03:36:52.545321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Cannot 'attach_volume' instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 while it is in vm_state rescued Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'server_id': '7dee71eb-cb9f-458e-96b2-4f6db8156153', 'body': {'volumeAttachment': {'volumeId': 'fef695ba-35cd-45f0-afb7-23d468dca125'}}} Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:36:52.546196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 while it is in vm_state rescued Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:36:52.547486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:36:52.548889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:36:52.548889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:36:52.548889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 while it is in vm_state rescued Jul 02 03:36:52.548889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:36:52.548889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Returning 409 to user: Cannot 'attach_volume' instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 while it is in vm_state rescued {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:36:52.548889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1235f20d-ad36-44a0-92fc-d384c051427c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043584 Jul 02 03:36:52.548889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 153/316] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:36:52 2022] POST /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 03:36:52.549798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:52.555075 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-64127d78-42cc-48c2-9ee1-1eeab40191b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:52.556009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-64127d78-42cc-48c2-9ee1-1eeab40191b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:52.559247 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-39e6355e-551f-4ec6-b776-2ef85d043d3b tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1284 microversion: 2.1 time: 0.112696 Jul 02 03:36:52.560881 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 164/317] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:52 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:52.562483 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64127d78-42cc-48c2-9ee1-1eeab40191b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.563068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64127d78-42cc-48c2-9ee1-1eeab40191b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.564030 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64127d78-42cc-48c2-9ee1-1eeab40191b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.564488 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64127d78-42cc-48c2-9ee1-1eeab40191b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.643654 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-64127d78-42cc-48c2-9ee1-1eeab40191b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153/action" status: 202 len: 0 microversion: 2.1 time: 0.092716 Jul 02 03:36:52.644625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 154/318] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:36:52 2022] POST /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 03:36:52.653520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:52.654123 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:52.661202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.661640 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.662405 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:52.662985 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:52.884126 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:52.893757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f3f8adfe-37f8-473d-a5ae-0a5e647985a7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1508 microversion: 2.1 time: 0.244565 Jul 02 03:36:52.903413 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 165/319] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:52 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:53.583209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:53.585172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:53.601988 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:53.602669 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:53.603631 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:53.604261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:53.850148 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:53.858908 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1d14248a-37f4-4939-981b-40a8b75905c3 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.284937 Jul 02 03:36:53.859815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 155/320] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:53 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:36:53.911895 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:53.912918 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:53.919472 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:53.920217 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:53.921114 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:53.921606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:54.314387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:54.322068 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3efff489-0d38-46f8-b434-7d3db5d8abe1 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1508 microversion: 2.1 time: 0.414379 Jul 02 03:36:54.331821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 166/321] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:53 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:54.441493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-7fc4baa5-416c-4023-921a-18fffb216411 req-b1419ff0-694e-4b81-ad61-c271b1e76b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b469211d-9cd9-495f-acbf-1af2e128d2ae", "tag": "d4b5f3d0-2c5b-4b62-967c-753987ada9d4"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:54.451549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-7fc4baa5-416c-4023-921a-18fffb216411 req-b1419ff0-694e-4b81-ad61-c271b1e76b8e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:54.451993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-7fc4baa5-416c-4023-921a-18fffb216411 req-b1419ff0-694e-4b81-ad61-c271b1e76b8e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:54.475120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-7fc4baa5-416c-4023-921a-18fffb216411 req-b1419ff0-694e-4b81-ad61-c271b1e76b8e service nova] Creating event network-changed:d4b5f3d0-2c5b-4b62-967c-753987ada9d4 for instance b469211d-9cd9-495f-acbf-1af2e128d2ae on hv-cinder-84684 Jul 02 03:36:54.482826 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-08ebab45-c38f-4f44-a8ab-952d445c8976 req-d8638d0c-e9c3-42a1-b413-698ff4a465c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c09baf3-acd2-45b3-bce4-9fd6b31efdac", "tag": "e19a69f0-6e0d-4a86-85f9-02d1861bdf96"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:54.491487 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-7fc4baa5-416c-4023-921a-18fffb216411 req-b1419ff0-694e-4b81-ad61-c271b1e76b8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054581 Jul 02 03:36:54.492349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 156/322] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:36:54.493538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-08ebab45-c38f-4f44-a8ab-952d445c8976 req-d8638d0c-e9c3-42a1-b413-698ff4a465c4 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:54.494268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-08ebab45-c38f-4f44-a8ab-952d445c8976 req-d8638d0c-e9c3-42a1-b413-698ff4a465c4 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:54.506752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-08ebab45-c38f-4f44-a8ab-952d445c8976 req-d8638d0c-e9c3-42a1-b413-698ff4a465c4 service nova] Creating event network-changed:e19a69f0-6e0d-4a86-85f9-02d1861bdf96 for instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac on hv-cinder-84684 Jul 02 03:36:54.512184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-08ebab45-c38f-4f44-a8ab-952d445c8976 req-d8638d0c-e9c3-42a1-b413-698ff4a465c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033695 Jul 02 03:36:54.512777 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 167/323] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:36:54.877852 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:54.878600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:54.884875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:54.885327 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:54.886150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:54.886542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:55.053804 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:55.061659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-de4280ad-a1bf-4167-b862-a95d536674f9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.189124 Jul 02 03:36:55.062317 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 157/324] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:54 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:55.339553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:55.340247 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:55.347195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:55.347907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:55.348692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:55.349129 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:55.364618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:55.490636 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:55.498234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-203c47db-7647-49f0-8a0e-161b4cf7bdb3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1508 microversion: 2.1 time: 0.162886 Jul 02 03:36:55.499106 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 168/325] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:55 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:56.082132 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:56.082868 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:56.084997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=66 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:56.091394 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:56.091849 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:56.092693 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:56.093322 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:56.238557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:56.246214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-59c4e002-0146-4a8e-80d5-41a7c38ac183 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.170917 Jul 02 03:36:56.246865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 158/326] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:56 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:56.516575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:56.517147 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:56.523343 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:56.523796 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:56.524573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:56.525009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:56.663864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:56.672590 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7c22a9cb-5c20-4c9c-8270-71a60131913a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1514 microversion: 2.1 time: 0.160085 Jul 02 03:36:56.673193 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 169/327] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:56 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:57.264297 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:57.265579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:57.272360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:57.272947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:57.274155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:57.274615 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:57.425134 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:57.432863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-650ca442-b8a4-4252-8f68-909e59167fb5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.173463 Jul 02 03:36:57.433675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 159/328] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:57 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:58.031264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7fb0eee1-90ac-4e2c-949b-b5be697366a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'create', calling method: .version_select at 0x7f2e9c017c10>, body: {"keypair": {"name": "tempest-keypair-1483951310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEwx7ToBoA0YVyW3HA0duN5ZT8+YMiam7wj/RKi+oB+zedvezRdvIT47HmfjKe9VQifyG3RD9cOJ9sAaLygJbvG/zZmhg0JfCSeVaO/rTEYq525jzXMHjgyiZ3PBY2SCg=="}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:58.037654 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:58.038317 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=6 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:58.054454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-7fb0eee1-90ac-4e2c-949b-b5be697366a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:36:58.058487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-7fb0eee1-90ac-4e2c-949b-b5be697366a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for user c941dc00e0584666aba13263b8c1fcb8 and project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:36:58.084967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7fb0eee1-90ac-4e2c-949b-b5be697366a9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058316 Jul 02 03:36:58.085592 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 170/329] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:36:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:36:58.450788 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:58.451568 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:58.453372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:58.461231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:58.461701 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:58.462498 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:58.463115 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:58.642360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:58.652224 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1cb36804-a466-4e2c-ae12-241c92eae27a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.206190 Jul 02 03:36:58.653122 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 160/330] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:58 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:36:59.607362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-623409445", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1d7a687-b6ca-47c7-af08-d5e3055ff439"}], "security_groups": [{"name": "tempest-securitygroup--1002002701"}], "key_name": "tempest-keypair-1483951310", "user_data": "}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:36:59.669258 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:36:59.669865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:36:59.676701 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:59.677145 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:59.677910 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:36:59.678345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:36:59.713006 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] validate_networks() for [('c1d7a687-b6ca-47c7-af08-d5e3055ff439', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:36:59.892613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:36:59.901802 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7ae028cc-5afb-405b-9a52-c76fbd82ff52 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.236658 Jul 02 03:36:59.902371 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 161/331] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:36:59 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:37:00.173885 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:37:00.174312 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:37:00.174789 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:37:00.175198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:37:00.175639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:37:00.184738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:00.185188 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:00.185979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:00.186405 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:00.202952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:37:00.207028 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Getting quotas for user c941dc00e0584666aba13263b8c1fcb8 and project 53c88ba2f03f47538ca0eaeb08ccfc07. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:37:00.217672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:37:00.220125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:37:00.271492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-821bfc8c-0023-4e4a-a90d-dd27868c00b3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.670983 Jul 02 03:37:00.272151 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 171/332] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:36:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:37:00.282276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-24ee795b-045f-43d7-8c92-0dd969976e28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:00.282883 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-24ee795b-045f-43d7-8c92-0dd969976e28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:00.336304 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-24ee795b-045f-43d7-8c92-0dd969976e28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:00.343349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-24ee795b-045f-43d7-8c92-0dd969976e28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1245 microversion: 2.1 time: 0.065043 Jul 02 03:37:00.343982 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 162/333] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:00 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:00.921038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:00.921664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:00.929014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:00.929463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:00.930234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:00.930671 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:01.063002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:01.075256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4f80167d-22d7-4eac-9dd3-38513be9a128 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.159416 Jul 02 03:37:01.076009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 172/334] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:00 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:01.365336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:01.366309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:01.378306 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:01.378749 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:01.379544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:01.379977 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:01.450599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:01.458237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fbe811fe-ec6f-4bee-9e68-880c99e1c8ef tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1297 microversion: 2.1 time: 0.100093 Jul 02 03:37:01.458792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 163/335] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:01 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:02.095777 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:02.096576 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:02.105061 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:02.105659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:02.106673 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:02.107250 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:02.244202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:02.251645 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b38ba7b1-e936-4fbc-8e87-2402215d8787 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.162241 Jul 02 03:37:02.252200 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 173/336] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:02 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:02.478404 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:02.479390 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:02.489801 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:02.490411 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:02.491498 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:02.492016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:02.559684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:02.568925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-12931890-1db5-40da-b166-680b1139f2ff tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1297 microversion: 2.1 time: 0.097035 Jul 02 03:37:02.569553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 164/337] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:02 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:03.274534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:03.275197 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:03.281600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:03.282058 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:03.282844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:03.283430 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:03.424703 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:03.432714 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9d43a3fc-c5a7-4f44-a417-fcde639a454f tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.162424 Jul 02 03:37:03.433266 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 174/338] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:03 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:03.591229 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:03.592195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:03.602838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:03.603644 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:03.604978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:03.605712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:03.622819 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:03.677246 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:03.684852 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ef29e47f-2b09-48af-910a-5d8f57538bd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1297 microversion: 2.1 time: 0.099805 Jul 02 03:37:03.685414 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 165/339] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:03 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:04.454221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:04.454820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:04.461601 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:04.462044 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:04.462824 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:04.463257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:04.603816 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:04.612377 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-23ac7f4a-590b-4d94-b1c7-a90ea2e89ee7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.161846 Jul 02 03:37:04.613386 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 175/340] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:04 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:04.702733 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:04.703359 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:04.710455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:04.710905 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:04.711696 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:04.712133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:04.785723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:04.793777 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6e697f18-e015-4cc6-ae76-4b490c7185d7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1305 microversion: 2.1 time: 0.095918 Jul 02 03:37:04.794870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 166/341] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:04 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:05.632177 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:05.632795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:05.639349 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:05.640013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:05.641204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:05.641802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:05.800022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:05.807754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9eedbd15-f4e8-4f95-a313-27c5ed186817 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.180866 Jul 02 03:37:05.811517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:05.820991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 176/342] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:05 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:05.822513 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:05.830607 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:05.831066 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:05.832050 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:05.832501 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:06.004844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:06.013477 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3f3c6cae-1e92-4192-8795-a47c76f5469c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.206009 Jul 02 03:37:06.014037 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 167/343] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:05 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:37:06.268500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-390813a1-b757-40dd-acde-282e6fc0ef11 req-54c1af9a-51d9-4331-b9b1-bae26b587e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee", "tag": "93c7269e-7d3c-40f8-8470-e61f2bab54ea"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:06.277121 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-390813a1-b757-40dd-acde-282e6fc0ef11 req-54c1af9a-51d9-4331-b9b1-bae26b587e7e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:06.277607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-390813a1-b757-40dd-acde-282e6fc0ef11 req-54c1af9a-51d9-4331-b9b1-bae26b587e7e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:06.297014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-390813a1-b757-40dd-acde-282e6fc0ef11 req-54c1af9a-51d9-4331-b9b1-bae26b587e7e service nova] Creating event network-changed:93c7269e-7d3c-40f8-8470-e61f2bab54ea for instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee on hv-cinder-84684 Jul 02 03:37:06.302352 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-390813a1-b757-40dd-acde-282e6fc0ef11 req-54c1af9a-51d9-4331-b9b1-bae26b587e7e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037623 Jul 02 03:37:06.302946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 177/344] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:06.828743 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:06.829503 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:06.836228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:06.836679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:06.837452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:06.837890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:06.932784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-729271dc-da79-4870-a2b2-f33c1b1f639b req-57296e3d-e5a9-4be8-bf0a-6574cfd87822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469211d-9cd9-495f-acbf-1af2e128d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "d4b5f3d0-2c5b-4b62-967c-753987ada9d4"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:06.943538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-729271dc-da79-4870-a2b2-f33c1b1f639b req-57296e3d-e5a9-4be8-bf0a-6574cfd87822 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:06.943999 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-729271dc-da79-4870-a2b2-f33c1b1f639b req-57296e3d-e5a9-4be8-bf0a-6574cfd87822 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:06.956424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-729271dc-da79-4870-a2b2-f33c1b1f639b req-57296e3d-e5a9-4be8-bf0a-6574cfd87822 service nova] Creating event network-vif-plugged:d4b5f3d0-2c5b-4b62-967c-753987ada9d4 for instance b469211d-9cd9-495f-acbf-1af2e128d2ae on hv-cinder-84684 Jul 02 03:37:06.962270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-729271dc-da79-4870-a2b2-f33c1b1f639b req-57296e3d-e5a9-4be8-bf0a-6574cfd87822 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034516 Jul 02 03:37:06.963565 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 178/345] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:06.981228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:06.990896 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2d5e566b-19be-4def-93ce-e1d1482ef9d5 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.166525 Jul 02 03:37:06.991839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 168/346] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:06 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:07.030737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:07.031518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:07.038377 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:07.038793 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:07.039633 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:07.040062 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:07.179213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:07.187166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-060e0774-da90-4e9f-8d66-7556a19f3a27 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.160754 Jul 02 03:37:07.187848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 179/347] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:07 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:08.013181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:08.014230 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:08.025924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:08.026694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:08.028023 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:08.028773 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:08.172089 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:08.180266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8fcd82a0-53db-4836-b978-cbe9d9df7ef9 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.173567 Jul 02 03:37:08.180829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 169/348] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:08 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:08.204240 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:08.204811 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:08.211244 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:08.211723 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:08.212479 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:08.212918 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:08.347578 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:08.355183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4d2079d8-6101-4b20-bc7f-c6f5a6452e96 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.154962 Jul 02 03:37:08.355799 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 180/349] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:08 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:09.201329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:09.202329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:09.209995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:09.210448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:09.211206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:09.211672 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:09.344036 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:09.352037 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-239c2827-bbdd-4fbf-aeee-fd67eea5adce tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.157202 Jul 02 03:37:09.352605 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 170/350] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:09 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:09.372383 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:09.372915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:09.379572 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:09.380020 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:09.380825 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:09.381258 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:09.521556 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:09.529491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-357d91df-1fa4-448b-ba13-17e6875bdfdd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.161037 Jul 02 03:37:09.530205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 181/351] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:09 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:10.369918 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:10.370527 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:10.373282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:10.379333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:10.379795 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:10.380611 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:10.381051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:10.526674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:10.535780 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-54921981-ff59-437c-be83-d7e29541c0da tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.169719 Jul 02 03:37:10.536345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 171/352] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:10 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:10.547264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:10.548642 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:10.550737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:10.551580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=10 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:10.557863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:10.558316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:10.559095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:10.559557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:10.700994 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:10.708935 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-956c0cb5-308e-4b58-9748-8f9ca78dde97 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.166326 Jul 02 03:37:10.709488 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 182/353] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:10 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:11.554213 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:11.554808 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:11.561480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:11.561938 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:11.562684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:11.563141 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:11.704532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:11.712922 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ad9119e8-a939-4d73-84c4-42504d5bf2eb tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1314 microversion: 2.1 time: 0.162471 Jul 02 03:37:11.713528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 172/354] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:11 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:11.726671 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:11.727394 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:11.736679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:11.737340 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:11.738489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:11.739095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:11.884440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:11.892537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fe4e0335-a36b-47d6-9e80-a605fb071ab3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.170483 Jul 02 03:37:11.893110 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 183/355] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:11 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:12.732344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:12.732925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:12.740465 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:12.740941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:12.741701 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:12.742181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:12.882429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:12.890431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-07260464-f792-460c-b55a-8c57fa7b4852 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1495 microversion: 2.1 time: 0.161988 Jul 02 03:37:12.891052 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 173/356] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:12 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1495 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:12.915269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:12.916006 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:12.919136 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:12.924647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:12.925101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:12.925875 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:12.926292 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:13.074309 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:13.083017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-095a35d9-99be-4bf6-bb7e-d8a5c2740385 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.171493 Jul 02 03:37:13.083675 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 184/357] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:12 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:13.467166 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-27ec1767-665b-4b51-bbd8-8fcbacfa08d9 req-3d5cf5ef-bc1d-48e2-a570-66d9f866d372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee", "name": "network-vif-plugged", "status": "completed", "tag": "93c7269e-7d3c-40f8-8470-e61f2bab54ea"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:13.476895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-27ec1767-665b-4b51-bbd8-8fcbacfa08d9 req-3d5cf5ef-bc1d-48e2-a570-66d9f866d372 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:13.477342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-27ec1767-665b-4b51-bbd8-8fcbacfa08d9 req-3d5cf5ef-bc1d-48e2-a570-66d9f866d372 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:13.501307 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-27ec1767-665b-4b51-bbd8-8fcbacfa08d9 req-3d5cf5ef-bc1d-48e2-a570-66d9f866d372 service nova] Creating event network-vif-plugged:93c7269e-7d3c-40f8-8470-e61f2bab54ea for instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee on hv-cinder-84684 Jul 02 03:37:13.502583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:13.503154 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:13.507536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-27ec1767-665b-4b51-bbd8-8fcbacfa08d9 req-3d5cf5ef-bc1d-48e2-a570-66d9f866d372 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043801 Jul 02 03:37:13.508149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 174/358] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:13.511186 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:13.511730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:13.512601 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:13.513105 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:13.539175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:37:13.626664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9e4332d2-db28-4939-a03c-99013e95621a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 204 len: 0 microversion: 2.1 time: 0.127857 Jul 02 03:37:13.627668 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 185/359] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:37:13 2022] DELETE /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:37:13.637065 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:13.637754 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:13.644508 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:13.644958 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:13.645920 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:13.646445 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:13.801353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:13.809986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f240dbda-2042-4778-8be4-9a3517469a83 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1501 microversion: 2.1 time: 0.177135 Jul 02 03:37:13.810599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 175/360] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:13 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:14.101454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:14.102106 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:14.108921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:14.109372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:14.110178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:14.110610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:14.126431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:14.247078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:14.254630 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-33448afc-d36a-4427-9955-518dc6b4af24 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.157548 Jul 02 03:37:14.255191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 186/361] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:14 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:14.830914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:14.831783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:14.838743 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:14.839189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:14.839977 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:14.840410 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:14.977659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:14.985294 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-64ddb24c-1fe2-4267-9904-237eb1490b12 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1501 microversion: 2.1 time: 0.160676 Jul 02 03:37:14.985845 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 176/362] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:14 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:15.276589 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:15.277559 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:15.286508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:15.286951 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:15.287736 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:15.288165 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:15.576256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:15.584538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5c6edfed-1cbe-430c-b081-9185dc468fd3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.314328 Jul 02 03:37:15.585109 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 187/363] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:15 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:16.003328 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:16.004004 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:16.011019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:16.011503 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:16.012259 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:16.012683 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:16.147194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:16.155004 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e03f0a47-7d39-4418-b36a-2d283dd4dfd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1501 microversion: 2.1 time: 0.156459 Jul 02 03:37:16.155633 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 177/364] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:15 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:16.603856 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:16.604576 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:16.613477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:16.614113 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:16.615210 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:16.615879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:16.766337 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:16.774457 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3d411e11-baa9-4a27-9d82-4cfabe917d28 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1371 microversion: 2.1 time: 0.176270 Jul 02 03:37:16.775011 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 188/365] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:16 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:17.173248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:17.173953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:17.182004 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:17.182451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:17.183221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:17.183852 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:17.320908 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:17.328533 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-eadb1ba5-6d6d-44e1-bdb6-326bd953c73c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1501 microversion: 2.1 time: 0.159796 Jul 02 03:37:17.329100 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 178/366] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:17 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:17.791813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:17.792589 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:17.799743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:17.800326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:17.801186 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:17.801726 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:17.941156 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:17.949017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-63a84c9f-be4e-4db0-ae32-7ee84a76ec7e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1565 microversion: 2.1 time: 0.161226 Jul 02 03:37:17.949616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 189/367] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:17 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:17.965792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-bcc5af71-80d0-4b43-a82b-7d0fcffd347e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:17.966272 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-bcc5af71-80d0-4b43-a82b-7d0fcffd347e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:17.972413 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bcc5af71-80d0-4b43-a82b-7d0fcffd347e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:17.973155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bcc5af71-80d0-4b43-a82b-7d0fcffd347e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:17.973903 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bcc5af71-80d0-4b43-a82b-7d0fcffd347e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:17.974339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bcc5af71-80d0-4b43-a82b-7d0fcffd347e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:18.056739 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-bcc5af71-80d0-4b43-a82b-7d0fcffd347e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095114 Jul 02 03:37:18.057326 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 179/368] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:37:17 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:18.193311 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-79e2c6d1-dcf3-4718-bbaa-d25fb45647b0 req-3df0dbf6-9f4c-4490-811c-0de8b8884e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469211d-9cd9-495f-acbf-1af2e128d2ae", "name": "network-vif-deleted", "tag": "d4b5f3d0-2c5b-4b62-967c-753987ada9d4"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:18.201407 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-79e2c6d1-dcf3-4718-bbaa-d25fb45647b0 req-3df0dbf6-9f4c-4490-811c-0de8b8884e79 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:18.201840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-79e2c6d1-dcf3-4718-bbaa-d25fb45647b0 req-3df0dbf6-9f4c-4490-811c-0de8b8884e79 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:18.213699 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-79e2c6d1-dcf3-4718-bbaa-d25fb45647b0 req-3df0dbf6-9f4c-4490-811c-0de8b8884e79 service nova] Creating event network-vif-deleted:d4b5f3d0-2c5b-4b62-967c-753987ada9d4 for instance b469211d-9cd9-495f-acbf-1af2e128d2ae on hv-cinder-84684 Jul 02 03:37:18.218515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-79e2c6d1-dcf3-4718-bbaa-d25fb45647b0 req-3df0dbf6-9f4c-4490-811c-0de8b8884e79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029055 Jul 02 03:37:18.221907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 190/369] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:18.345432 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:18.346172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:18.365010 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:18.365861 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:18.367144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:18.367880 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:18.477291 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:18.484899 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-11d9162b-d559-4f8e-8181-3f5a7faa3445 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1459 microversion: 2.1 time: 0.143497 Jul 02 03:37:18.485431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 180/370] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:18 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1459 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:19.324959 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-82790248-796e-43af-8925-742485f547e4 req-ed6171cc-dc42-4ae8-b64a-b0287c1ab48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee", "tag": "93c7269e-7d3c-40f8-8470-e61f2bab54ea"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:19.333989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-82790248-796e-43af-8925-742485f547e4 req-ed6171cc-dc42-4ae8-b64a-b0287c1ab48e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:19.334441 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-82790248-796e-43af-8925-742485f547e4 req-ed6171cc-dc42-4ae8-b64a-b0287c1ab48e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:19.351600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-82790248-796e-43af-8925-742485f547e4 req-ed6171cc-dc42-4ae8-b64a-b0287c1ab48e service nova] Creating event network-changed:93c7269e-7d3c-40f8-8470-e61f2bab54ea for instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee on hv-cinder-84684 Jul 02 03:37:19.356370 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-82790248-796e-43af-8925-742485f547e4 req-ed6171cc-dc42-4ae8-b64a-b0287c1ab48e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035567 Jul 02 03:37:19.356958 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 191/371] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:19.506930 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:19.510028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:19.518834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:19.521502 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:19.522609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:19.523243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:19.558229 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:19.558679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:19.559196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lazy-loading 'fault' on Instance uuid b469211d-9cd9-495f-acbf-1af2e128d2ae {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:37:19.633369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:19.656813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f017b71b-ab1f-4057-b2a5-da4523f9797d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 200 len: 1304 microversion: 2.1 time: 0.153044 Jul 02 03:37:19.661644 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 181/372] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:19 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:20.680520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:20.681224 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: b469211d-9cd9-495f-acbf-1af2e128d2ae] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:20.688159 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:20.688598 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:20.689366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:20.689818 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:20.703248 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] HTTP exception thrown: Instance b469211d-9cd9-495f-acbf-1af2e128d2ae could not be found. Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Request method failure captured: Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae HTTP/1.1 Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv71K7iFb8DNsAMS8fDNX_vD13buNQVts2JQeezZl_bPO7KtJMHSjJs9SloTZPgCM87V4PCbFUyrKvDtApHzTHGwCe6V7VFQNb2oP__y7gogkhFzBAokvxsLhQmvezx9B76oflUEyFLSngrSVDsAXy8Udd5iTNVDKxlgJCVosF2NucGQ Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 81a1413099324b758a2608fa5d67c0a3 Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesActionsTest-998530368 Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:37:20.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/81a1413099324b758a2608fa5d67c0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/81a1413099324b758a2608fa5d67c0a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/81a1413099324b758a2608fa5d67c0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_81a1413099324b758a2608fa5d67c0a3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesActionsTest-998530368 Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 81a1413099324b758a2608fa5d67c0a3 Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesActionsTest-998530368 Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesActionsTest-998530368-project Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 662efed3aab046bfb378bbffc49a9c11 Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesActionsTest-998530368-project Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance b469211d-9cd9-495f-acbf-1af2e128d2ae could not be found. Jul 02 03:37:20.706418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'b469211d-9cd9-495f-acbf-1af2e128d2ae'} Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b469211d-9cd9-495f-acbf-1af2e128d2ae could not be found. Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:37:20.707455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b469211d-9cd9-495f-acbf-1af2e128d2ae could not be found. Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b469211d-9cd9-495f-acbf-1af2e128d2ae could not be found. Jul 02 03:37:20.709125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:20.710227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Returning 404 to user: Instance b469211d-9cd9-495f-acbf-1af2e128d2ae could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:37:20.710227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-556d0e71-d681-491b-abce-6b3ea9241bf7 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae" status: 404 len: 111 microversion: 2.1 time: 0.030731 Jul 02 03:37:20.710227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 192/373] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:20 2022] GET /compute/v2.1/servers/b469211d-9cd9-495f-acbf-1af2e128d2ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:37:20.823525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-191031051", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "networks": [{"uuid": "7e34743c-39b1-41c2-b662-fc644b4f04d0"}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:20.904792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] validate_networks() for [('7e34743c-39b1-41c2-b662-fc644b4f04d0', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:37:21.289329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:37:21.289921 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:37:21.290440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:37:21.291013 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:37:21.291686 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:37:21.304927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:21.305576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:21.306859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:21.307588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:21.327589 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Getting quotas for project 81a1413099324b758a2608fa5d67c0a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:37:21.332004 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Getting quotas for user 662efed3aab046bfb378bbffc49a9c11 and project 81a1413099324b758a2608fa5d67c0a3. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:37:21.343637 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:37:21.346064 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:37:21.395624 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ea805d4d-78c7-4b04-87b6-3b0fbd094dd2 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578379 Jul 02 03:37:21.396294 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 182/374] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:37:21.406773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b116dbcb-8f3e-4926-b208-2d7933e38834 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:21.407552 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b116dbcb-8f3e-4926-b208-2d7933e38834 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:21.464306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b116dbcb-8f3e-4926-b208-2d7933e38834 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:21.472097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b116dbcb-8f3e-4926-b208-2d7933e38834 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1213 microversion: 2.1 time: 0.069214 Jul 02 03:37:21.473553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 193/375] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:21 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:22.491922 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:22.492616 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:22.501894 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:22.502453 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:22.503507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:22.503963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:22.518648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:22.571076 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:22.579234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2f172019-995b-4abf-99d7-d9a2b60dc0a6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1265 microversion: 2.1 time: 0.093392 Jul 02 03:37:22.579838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 183/376] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:22 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:23.598812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:23.599537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:23.605913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:23.607070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:23.607933 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:23.608395 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:23.758824 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:23.767428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5c2ba3cf-5a51-4989-b7e7-21848f24b6ae tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.173579 Jul 02 03:37:23.768211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 194/377] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:23 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:24.319630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-bbcb4608-ff48-441b-8f42-f034d9b3fefb req-cc01074c-d297-462c-9eac-fb8ad0c3d132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb12d3e6-5bb3-4e2f-84c2-7912f20941dc", "tag": "07e1476a-bc3d-4b1b-8ca0-704ca496c3eb"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:24.329045 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-bbcb4608-ff48-441b-8f42-f034d9b3fefb req-cc01074c-d297-462c-9eac-fb8ad0c3d132 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:24.329472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-bbcb4608-ff48-441b-8f42-f034d9b3fefb req-cc01074c-d297-462c-9eac-fb8ad0c3d132 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:24.342050 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-bbcb4608-ff48-441b-8f42-f034d9b3fefb req-cc01074c-d297-462c-9eac-fb8ad0c3d132 service nova] Creating event network-changed:07e1476a-bc3d-4b1b-8ca0-704ca496c3eb for instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc on hv-cinder-84684 Jul 02 03:37:24.347204 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-bbcb4608-ff48-441b-8f42-f034d9b3fefb req-cc01074c-d297-462c-9eac-fb8ad0c3d132 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031458 Jul 02 03:37:24.348035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 184/378] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:24.785586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:24.786161 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:24.794750 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:24.795201 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:24.796036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:24.796439 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:24.944742 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:24.953477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f484847e-d53b-4176-ac53-340f7250755d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.172599 Jul 02 03:37:24.954342 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 195/379] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:24 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:25.974240 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:25.975003 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:25.982440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:25.982891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:25.983697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:25.984134 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:26.127075 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:26.136843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-520fb298-c96c-4f6f-8303-5555a4a70f4e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.167548 Jul 02 03:37:26.137591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 185/380] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:25 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:27.154236 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:27.154813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:27.161415 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:27.161858 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:27.162612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:27.163046 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:27.309385 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:27.317172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5e571ecc-a438-46cc-95f8-180ad3796fc4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.166870 Jul 02 03:37:27.317734 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 196/381] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:27 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:28.335169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:28.335847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:28.338270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:28.344342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:28.344822 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:28.345635 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:28.345995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:28.484366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:28.491997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3b5b6a4d-9808-45c3-86bf-316e39c5885e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.161119 Jul 02 03:37:28.492785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 186/382] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:28 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:29.509369 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:29.509977 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:29.516082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:29.516530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:29.517291 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:29.517745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:29.651725 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:29.659381 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-efdc3db3-dec6-4357-92e4-69c0c010d626 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.153682 Jul 02 03:37:29.660183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 197/383] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:29 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:30.677579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:30.678345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:30.685840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:30.686285 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:30.687090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:30.687603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:30.822541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:30.830756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e8677bf5-78da-44f8-9477-1f8cedc89a7d tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.157393 Jul 02 03:37:30.831407 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 187/384] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:30 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:31.849971 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:31.850574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:31.852698 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:31.858424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:31.858869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:31.859650 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:31.860093 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:31.999963 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:32.007567 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cf97c307-eab9-4246-a07b-4a073685ccda tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.162653 Jul 02 03:37:32.011336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 198/385] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:31 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:32.080109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-3d209eca-53ac-41ee-a6f2-95b79f9103ef req-b4c6d096-1c8d-4e1f-b0fc-97941634db89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb12d3e6-5bb3-4e2f-84c2-7912f20941dc", "name": "network-vif-plugged", "status": "completed", "tag": "07e1476a-bc3d-4b1b-8ca0-704ca496c3eb"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:32.083812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:32.084797 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:32.093493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-3d209eca-53ac-41ee-a6f2-95b79f9103ef req-b4c6d096-1c8d-4e1f-b0fc-97941634db89 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:32.093941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-3d209eca-53ac-41ee-a6f2-95b79f9103ef req-b4c6d096-1c8d-4e1f-b0fc-97941634db89 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:32.108563 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-3d209eca-53ac-41ee-a6f2-95b79f9103ef req-b4c6d096-1c8d-4e1f-b0fc-97941634db89 service nova] Creating event network-vif-plugged:07e1476a-bc3d-4b1b-8ca0-704ca496c3eb for instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc on hv-cinder-84684 Jul 02 03:37:32.113876 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-3d209eca-53ac-41ee-a6f2-95b79f9103ef req-b4c6d096-1c8d-4e1f-b0fc-97941634db89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037471 Jul 02 03:37:32.114476 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 188/386] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:33.024792 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:33.025435 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:33.034647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:33.035095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:33.035926 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:33.036361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:33.174469 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:33.182660 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e45b5ed3-d9cb-4b6e-9678-a0d0addb82aa tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.161886 Jul 02 03:37:33.183214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 199/387] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:33 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:34.206197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:34.207066 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:34.216046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:34.216491 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:34.217253 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:34.217679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:34.356461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:34.364835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cb15b2dc-9295-475c-b081-252b454ce9ef tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1313 microversion: 2.1 time: 0.167786 Jul 02 03:37:34.365390 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 189/388] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:34 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:35.381932 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:35.382549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:35.388755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:35.389209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:35.389978 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:35.390414 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:35.545387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:35.554565 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-32e95a45-fed1-425d-b465-5efa61e7ee9e tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1494 microversion: 2.1 time: 0.176886 Jul 02 03:37:35.555144 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 200/389] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:35 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1494 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:36.896600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:36.897130 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:36.904229 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:36.905054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:36.905905 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:36.906372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:36.933668 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:37:37.024104 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-10a8ecb6-b4b8-4fc8-b63f-089281fa619a tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 204 len: 0 microversion: 2.1 time: 0.132089 Jul 02 03:37:37.024752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 190/390] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:37:36 2022] DELETE /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:37:37.033183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:37.033789 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:37.040233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:37.040679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:37.041582 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:37.042016 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:37.174107 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:37.181831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6ec14a87-468f-4f68-a910-e9795d81970c tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1500 microversion: 2.1 time: 0.152659 Jul 02 03:37:37.182398 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 201/391] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:37 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:38.199769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:38.200493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:38.207633 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:38.208081 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:38.208850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:38.209290 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:38.354554 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:38.362521 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c1de1262-6d30-40c3-ba07-60e593d681d4 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1500 microversion: 2.1 time: 0.167280 Jul 02 03:37:38.363090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 191/392] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:38 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:39.379561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:39.380324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:39.386958 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:39.387491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:39.388251 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:39.388762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:39.530853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662efed3aab046bfb378bbffc49a9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a1413099324b758a2608fa5d67c0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:39.539865 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-64ea5426-bfcf-42b1-b5fc-6533876537f6 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 200 len: 1500 microversion: 2.1 time: 0.164434 Jul 02 03:37:39.540762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 202/393] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:39 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:39.607466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-52a29507-80e6-4212-9db9-bf824754b5c0 req-2779023b-5527-4bfe-9a17-4eb4ce809447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb12d3e6-5bb3-4e2f-84c2-7912f20941dc", "name": "network-vif-deleted", "tag": "07e1476a-bc3d-4b1b-8ca0-704ca496c3eb"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:39.618215 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-52a29507-80e6-4212-9db9-bf824754b5c0 req-2779023b-5527-4bfe-9a17-4eb4ce809447 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:39.618660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-52a29507-80e6-4212-9db9-bf824754b5c0 req-2779023b-5527-4bfe-9a17-4eb4ce809447 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:39.629423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-52a29507-80e6-4212-9db9-bf824754b5c0 req-2779023b-5527-4bfe-9a17-4eb4ce809447 service nova] Creating event network-vif-deleted:07e1476a-bc3d-4b1b-8ca0-704ca496c3eb for instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc on hv-cinder-84684 Jul 02 03:37:39.634950 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-52a29507-80e6-4212-9db9-bf824754b5c0 req-2779023b-5527-4bfe-9a17-4eb4ce809447 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031430 Jul 02 03:37:39.635626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 192/394] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:40.557553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:40.558180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] [instance: fb12d3e6-5bb3-4e2f-84c2-7912f20941dc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:40.564469 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:40.564915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:40.565687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:40.566120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:40.584168 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] HTTP exception thrown: Instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc could not be found. Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Request method failure captured: Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc HTTP/1.1 Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv71K7iFb8DNsAMS8fDNX_vD13buNQVts2JQeezZl_bPO7KtJMHSjJs9SloTZPgCM87V4PCbFUyrKvDtApHzTHGwCe6V7VFQNb2oP__y7gogkhFzBAokvxsLhQmvezx9B76oflUEyFLSngrSVDsAXy8Udd5iTNVDKxlgJCVosF2NucGQ Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 81a1413099324b758a2608fa5d67c0a3 Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesActionsTest-998530368 Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:37:40.585830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/81a1413099324b758a2608fa5d67c0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/81a1413099324b758a2608fa5d67c0a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/81a1413099324b758a2608fa5d67c0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_81a1413099324b758a2608fa5d67c0a3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesActionsTest-998530368 Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 81a1413099324b758a2608fa5d67c0a3 Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesActionsTest-998530368 Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesActionsTest-998530368-project Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 662efed3aab046bfb378bbffc49a9c11 Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesActionsTest-998530368-project Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc could not be found. Jul 02 03:37:40.587406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'fb12d3e6-5bb3-4e2f-84c2-7912f20941dc'} Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc could not be found. Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:37:40.588320 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc could not be found. Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc could not be found. Jul 02 03:37:40.589632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:37:40.590890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] Returning 404 to user: Instance fb12d3e6-5bb3-4e2f-84c2-7912f20941dc could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:37:40.590890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e74fd846-5eac-4275-9730-44542e2e1112 tempest-VolumesActionsTest-998530368 tempest-VolumesActionsTest-998530368-project] 10.222.0.42 "GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc" status: 404 len: 111 microversion: 2.1 time: 0.033827 Jul 02 03:37:40.590890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 203/395] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:40 2022] GET /compute/v2.1/servers/fb12d3e6-5bb3-4e2f-84c2-7912f20941dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:37:48.221607 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-258199733", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "networks": [{"uuid": "ffa95e81-0ba1-4cca-87ba-54c202a4f9a5"}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:48.278798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] validate_networks() for [('ffa95e81-0ba1-4cca-87ba-54c202a4f9a5', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:37:48.673340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:37:48.673761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:37:48.674235 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:37:48.674643 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:37:48.675036 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:37:48.686558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:48.687121 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:48.688190 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:48.689015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:48.709746 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Getting quotas for project 8eba05f9e3a8402f96924c5c715229a5. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:37:48.714946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Getting quotas for user a6346c2aa3ab4ebabd9bbd0b9c441ad3 and project 8eba05f9e3a8402f96924c5c715229a5. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:37:48.728941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:37:48.732724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:37:48.797943 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9cf8041a-9c03-49d1-832b-10f70f3cb1ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581350 Jul 02 03:37:48.804068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 193/396] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:37:48.809586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-865f4777-f188-4118-a26e-509292091601 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:48.810397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-865f4777-f188-4118-a26e-509292091601 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:48.813039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:48.882829 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-865f4777-f188-4118-a26e-509292091601 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:48.890444 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-865f4777-f188-4118-a26e-509292091601 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1218 microversion: 2.1 time: 0.085172 Jul 02 03:37:48.891017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 204/397] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:48 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:49.909150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:49.910524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:49.918838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:49.919316 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:49.920148 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:49.920600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:50.015990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:50.028111 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2d9b6873-ff40-4ae7-9dc2-e51c864b8dd7 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1270 microversion: 2.1 time: 0.123767 Jul 02 03:37:50.029012 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 194/398] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:49 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:51.049871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:51.051506 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:51.053779 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=83 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:51.059172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:51.059647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:51.060612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:51.061211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:51.228496 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:51.237167 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-351814eb-96a0-4953-8039-e7e94267baa0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.191010 Jul 02 03:37:51.237623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 205/399] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:51 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:51.721168 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-2eb85e04-8f36-4665-8211-6732f06776b2 req-301f8553-6ad3-4275-b9ec-1724122ba0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0004653b-9bc7-4d42-a7af-51f8b04352b8", "tag": "7c96ddc8-ca7b-4f34-8c1f-5998b91f662b"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:51.736281 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-2eb85e04-8f36-4665-8211-6732f06776b2 req-301f8553-6ad3-4275-b9ec-1724122ba0fb service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:51.743737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-2eb85e04-8f36-4665-8211-6732f06776b2 req-301f8553-6ad3-4275-b9ec-1724122ba0fb service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:51.756890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-2eb85e04-8f36-4665-8211-6732f06776b2 req-301f8553-6ad3-4275-b9ec-1724122ba0fb service nova] Creating event network-changed:7c96ddc8-ca7b-4f34-8c1f-5998b91f662b for instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 on hv-cinder-84684 Jul 02 03:37:51.761804 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-2eb85e04-8f36-4665-8211-6732f06776b2 req-301f8553-6ad3-4275-b9ec-1724122ba0fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047290 Jul 02 03:37:51.762710 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 195/400] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:52.254249 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:52.255026 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:52.261616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:52.262462 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:52.264169 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:52.264902 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:52.427079 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:52.443127 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-608598f6-c6ac-4f27-b24a-31db102a36b8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.192091 Jul 02 03:37:52.444328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 206/401] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:52 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:53.462173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:53.463059 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:53.470341 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:53.471069 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:53.472149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:53.472815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:53.497690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:53.627859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:53.638480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c0491f97-5d1d-405d-8f77-8414355255ab tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.180863 Jul 02 03:37:53.658947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 196/402] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:53 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:54.670124 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:54.675119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:54.686596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:54.686831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:54.687485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:54.687941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:54.842587 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:54.850829 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3fece72a-e6ba-4e51-b111-4fb6d9ec3b7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.188573 Jul 02 03:37:54.859727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 207/403] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:54 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:55.867914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:55.869343 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:55.876360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:55.877447 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:55.878771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:55.879507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:56.026728 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:56.035860 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dc9ad0cc-a708-4c88-8e60-a00112de8c1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.171889 Jul 02 03:37:56.037027 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 197/404] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:55 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:57.054814 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:57.055581 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:57.062765 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:57.063018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:57.063975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:57.064770 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:57.213564 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:57.223736 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-954c5cd1-62de-4422-99f1-5a28fdba176d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.173936 Jul 02 03:37:57.224553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 208/405] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:57 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:58.241741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:58.242629 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:58.249787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:58.250248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:58.251021 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:58.251486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:58.393763 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:58.402073 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5438e648-7f21-4c05-909f-1233e90f0bdd tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.164471 Jul 02 03:37:58.402895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 198/406] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:58 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:37:58.638194 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-184ad705-e129-45e1-b29a-222b7a622868 req-320abf98-7096-41ed-b904-188eb913cadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0004653b-9bc7-4d42-a7af-51f8b04352b8", "name": "network-vif-plugged", "status": "completed", "tag": "7c96ddc8-ca7b-4f34-8c1f-5998b91f662b"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:37:58.663213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-184ad705-e129-45e1-b29a-222b7a622868 req-320abf98-7096-41ed-b904-188eb913cadd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:58.667568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-184ad705-e129-45e1-b29a-222b7a622868 req-320abf98-7096-41ed-b904-188eb913cadd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:58.682734 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-184ad705-e129-45e1-b29a-222b7a622868 req-320abf98-7096-41ed-b904-188eb913cadd service nova] Creating event network-vif-plugged:7c96ddc8-ca7b-4f34-8c1f-5998b91f662b for instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 on hv-cinder-84684 Jul 02 03:37:58.689830 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-184ad705-e129-45e1-b29a-222b7a622868 req-320abf98-7096-41ed-b904-188eb913cadd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056045 Jul 02 03:37:58.690656 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 209/407] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:37:59.420294 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:37:59.420955 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:37:59.425620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:59.427008 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:59.429485 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:59.435534 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:59.436337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:59.437332 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:37:59.437946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:37:59.619466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:37:59.632048 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d5f6caba-3ef2-49e7-94e8-b86ad5ccc445 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.215951 Jul 02 03:37:59.632811 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 199/408] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:37:59 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:00.656920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:00.662345 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:00.663131 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:00.670879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:00.671405 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:00.672506 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:00.673166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:00.835724 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:00.843868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1f2a07b6-891f-412c-bacf-487aa53f0bd5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1318 microversion: 2.1 time: 0.187781 Jul 02 03:38:00.845468 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 210/409] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:00 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:01.862451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:01.863149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:01.872228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:01.872803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:01.873662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:01.874280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:02.017566 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:02.025264 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d8c241dc-c576-427d-aea3-f46fb88f56a9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1508 microversion: 2.1 time: 0.167088 Jul 02 03:38:02.025853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 200/410] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:01 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:05.498954 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ad8325fa-cd3a-495c-b0c2-728b9a6368f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:05.499569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ad8325fa-cd3a-495c-b0c2-728b9a6368f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:05.505795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ad8325fa-cd3a-495c-b0c2-728b9a6368f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:05.506252 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ad8325fa-cd3a-495c-b0c2-728b9a6368f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:05.507028 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ad8325fa-cd3a-495c-b0c2-728b9a6368f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:05.507508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ad8325fa-cd3a-495c-b0c2-728b9a6368f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:05.534279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ad8325fa-cd3a-495c-b0c2-728b9a6368f7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/ips" status: 200 len: 150 microversion: 2.1 time: 0.039295 Jul 02 03:38:05.534850 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 211/411] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:38:05 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:38:07.998411 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cf2d11b8-341b-4b71-92da-f26af54d9246 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78fffb3e-e29d-4700-b4ac-875f811d95d2"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:07.999504 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cf2d11b8-341b-4b71-92da-f26af54d9246 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:08.006370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2d11b8-341b-4b71-92da-f26af54d9246 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:08.006811 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2d11b8-341b-4b71-92da-f26af54d9246 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:08.007608 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2d11b8-341b-4b71-92da-f26af54d9246 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:08.008041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2d11b8-341b-4b71-92da-f26af54d9246 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:08.304590 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cf2d11b8-341b-4b71-92da-f26af54d9246 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310060 Jul 02 03:38:08.305188 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 201/412] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:38:07 2022] POST /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:38:15.838641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d7ad7538-cb43-48ac-bfc2-e893e10d96bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: .version_select at 0x7f2e9c331af0>, body: {"keypair": {"name": "tempest-keypair-65762965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJCM8LRLptg75EsGC4KjrlIQCxKVHwOyG09hpoUOCNEofARDAD9ftjPST123hwuUKuB6lPYBsZUw1M+A1NKu+1ztYY3PaK1lGYtcqar151tdE8UtbM5omcZ1y3O+wEf6A=="}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:15.843901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=17 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:15.844625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=36 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:15.858104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-d7ad7538-cb43-48ac-bfc2-e893e10d96bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:38:15.862116 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-d7ad7538-cb43-48ac-bfc2-e893e10d96bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:38:15.887669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d7ad7538-cb43-48ac-bfc2-e893e10d96bf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053925 Jul 02 03:38:15.888174 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 212/413] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:38:15 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:38:16.275454 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9c14908e-29cc-4d7d-ac3e-dadec7b33900 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:16.276170 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9c14908e-29cc-4d7d-ac3e-dadec7b33900 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:16.283352 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c14908e-29cc-4d7d-ac3e-dadec7b33900 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:16.283808 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c14908e-29cc-4d7d-ac3e-dadec7b33900 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:16.284576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c14908e-29cc-4d7d-ac3e-dadec7b33900 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:16.285007 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9c14908e-29cc-4d7d-ac3e-dadec7b33900 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:16.309764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9c14908e-29cc-4d7d-ac3e-dadec7b33900 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/ips" status: 200 len: 153 microversion: 2.20 time: 0.039834 Jul 02 03:38:16.310279 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 202/414] 10.222.0.42 () {60 vars in 1288 bytes} [Sat Jul 2 03:38:16 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:38:17.251722 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-807307732", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "389311ee-b4f4-4d7f-89a6-51f9bda5ef70"}], "security_groups": [{"name": "tempest-securitygroup--700589700"}], "key_name": "tempest-keypair-65762965", "user_data": "}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:17.362825 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] validate_networks() for [('389311ee-b4f4-4d7f-89a6-51f9bda5ef70', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:38:17.746239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:38:17.746690 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:38:17.747167 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:38:17.747669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:38:17.748205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:38:17.757790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:17.758263 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:17.759060 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:17.759541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:17.777969 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:38:17.782094 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:38:17.794643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:38:17.797029 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:38:17.849334 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8eea5f03-05d6-4f78-8913-2ae3fc4d8e4d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602008 Jul 02 03:38:17.849969 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 213/415] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:38:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:38:17.860445 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3e514315-22f1-4214-a8e2-3a2f893001e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:17.861087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3e514315-22f1-4214-a8e2-3a2f893001e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:17.921429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3e514315-22f1-4214-a8e2-3a2f893001e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:17.928597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3e514315-22f1-4214-a8e2-3a2f893001e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1239 microversion: 2.1 time: 0.072019 Jul 02 03:38:17.929184 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 203/416] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:17 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:18.948940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:18.949494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:18.959927 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:18.960550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:18.961707 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:18.962276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:19.023821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:19.031783 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1e72c552-d19f-4811-86dc-40870a2509e0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1291 microversion: 2.1 time: 0.088990 Jul 02 03:38:19.032337 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 214/417] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:18 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1291 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:19.439880 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:19.440429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:19.448553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:19.449005 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:19.449773 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:19.450201 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:19.472512 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lazy-loading 'flavor' on Instance uuid bd2d5a1f-4e5b-4072-851a-d01f23742f55 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:38:19.742023 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0a3f2466-8a54-4815-b8be-dc100cdeec30 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/action" status: 202 len: 0 microversion: 2.20 time: 0.306098 Jul 02 03:38:19.742756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 204/418] 10.222.0.42 () {62 vars in 1318 bytes} [Sat Jul 2 03:38:19 2022] POST /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:38:19.751782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:19.752397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:19.759130 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:19.759628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:19.760715 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:19.761152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:19.896763 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:19.905414 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:19.906911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:19.908114 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e93e6ee4-58b0-4cbf-9697-219831d87ae5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.160741 Jul 02 03:38:19.908660 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 215/419] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:19 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:38:20.050578 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:20.051404 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:20.058162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:20.058825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:20.059664 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:20.060111 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:20.123036 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:20.130845 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-156e505a-ffb4-40cb-97dc-d1ebf9c7c024 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1297 microversion: 2.1 time: 0.085078 Jul 02 03:38:20.135775 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 205/420] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:20 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:20.929715 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:20.930257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:20.937941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:20.938397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:20.939268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:20.939743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:21.070577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:21.079471 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:21.080981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:21.082148 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b8426b12-7ac1-4f5e-bf01-3f34697b1d0d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.156843 Jul 02 03:38:21.082712 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 216/421] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:20 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:21.148701 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:21.149310 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:21.165760 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:21.166267 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:21.167160 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:21.168509 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:21.308938 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:21.318796 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9e4ac0f7-8511-4203-9c2f-0ed70517ae8a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.172142 Jul 02 03:38:21.329034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 206/422] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:21 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:21.387223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-f86349bf-abf6-4dd4-8987-6e1cca8afc6c req-b9a8e107-cf58-4822-b437-e36fad5d033e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671321a8-96a7-4fc0-96b1-0fd9b12dc028", "tag": "bb25a94a-0fca-42e7-a4a5-8f6b9068b426"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:21.405365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-f86349bf-abf6-4dd4-8987-6e1cca8afc6c req-b9a8e107-cf58-4822-b437-e36fad5d033e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:21.405823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-f86349bf-abf6-4dd4-8987-6e1cca8afc6c req-b9a8e107-cf58-4822-b437-e36fad5d033e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:21.420965 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-f86349bf-abf6-4dd4-8987-6e1cca8afc6c req-b9a8e107-cf58-4822-b437-e36fad5d033e service nova] Creating event network-changed:bb25a94a-0fca-42e7-a4a5-8f6b9068b426 for instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 on hv-cinder-84684 Jul 02 03:38:21.426485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-f86349bf-abf6-4dd4-8987-6e1cca8afc6c req-b9a8e107-cf58-4822-b437-e36fad5d033e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044228 Jul 02 03:38:21.427077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 217/423] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:38:22.104744 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:22.105649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:22.118717 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:22.119547 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:22.120734 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:22.121197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:22.255374 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:22.265976 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:22.268084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:22.269854 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d77ad0fe-1361-4c57-904f-d9aeeee826be tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.171628 Jul 02 03:38:22.270680 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 207/424] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:22 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:22.339512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:22.340368 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:22.351267 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:22.352053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:22.353304 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:22.354020 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:22.500405 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:22.508293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-962fb565-0a4d-40c8-86b4-1e69feb74f57 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.174985 Jul 02 03:38:22.508837 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 218/425] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:22 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:23.288808 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:23.289371 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:23.296716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:23.297161 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:23.297914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:23.298348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:23.444165 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:23.456615 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:23.458900 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:23.460552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e7cb8283-d203-4349-a6fc-5d8e21bd25c9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.175382 Jul 02 03:38:23.461333 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 208/426] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:23 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:23.527096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:23.527827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:23.534023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:23.534571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:23.535404 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:23.535936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:23.676982 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:23.685053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ec79b459-a766-4a31-87e1-e459b76c77a9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.163172 Jul 02 03:38:23.685616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 219/427] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:23 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:24.480126 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:24.480796 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:24.487884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:24.488328 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:24.489083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:24.489843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:24.492500 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:24.629057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:24.637298 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:24.638853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:24.640052 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5d995ca7-c809-4240-9a06-a62500beb97b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.164268 Jul 02 03:38:24.640597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 209/428] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:24 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:24.702038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:24.702568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:24.709023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:24.709475 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:24.710239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:24.710672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:24.859712 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:24.867542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-143763e4-038b-4ddc-beb7-e0815eb90142 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.169785 Jul 02 03:38:24.868110 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 220/429] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:24 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:25.658555 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:25.659163 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:25.665892 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:25.666348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:25.667114 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:25.667584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:25.802337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:25.810358 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:25.811886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:25.813038 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3bacd8a0-a48b-40d3-adf2-5d2696f547cd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.158842 Jul 02 03:38:25.813602 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 210/430] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:25 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:25.887902 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:25.889057 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:25.898427 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:25.899111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:25.900324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:25.900990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:26.042375 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:26.051230 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f824f4b3-9b08-4215-9052-a49436d8dfd9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.169408 Jul 02 03:38:26.051878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 221/431] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:25 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:26.833833 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:26.834517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:26.843710 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:26.844309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:26.845274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:26.845892 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:26.977256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:26.985428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:26.986935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:26.988111 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ee87d715-5888-45bc-8643-8eaa3b47399c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.159662 Jul 02 03:38:26.988640 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 211/432] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:26 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:27.069882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:27.070650 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:27.078520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:27.078960 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:27.079754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:27.080176 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:27.216246 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:27.224754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9e4dc2ab-9fec-4496-9140-b226afffef48 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.159878 Jul 02 03:38:27.225339 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 222/433] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:27 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:27.782214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-96e70f23-cae6-4f8d-b5f8-c05cce528f50 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03f07c00-755d-4289-8587-1bbf2db2ab21", "device": "/dev/sdb"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:27.784345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-96e70f23-cae6-4f8d-b5f8-c05cce528f50 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:27.792462 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96e70f23-cae6-4f8d-b5f8-c05cce528f50 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:27.793058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96e70f23-cae6-4f8d-b5f8-c05cce528f50 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:27.794594 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96e70f23-cae6-4f8d-b5f8-c05cce528f50 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:27.795121 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-96e70f23-cae6-4f8d-b5f8-c05cce528f50 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:27.926061 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:28.006364 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:28.006987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:28.009004 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:28.009643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=10 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:28.015800 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:28.016253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:28.017023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:28.017467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:28.075356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-96e70f23-cae6-4f8d-b5f8-c05cce528f50 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "POST /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296918 Jul 02 03:38:28.075999 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 212/434] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:38:27 2022] POST /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:38:28.159417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:28.167218 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:28.169036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:28.170251 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5c68f89c-5743-4f6f-88bf-4d2b95e3ecba tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.167779 Jul 02 03:38:28.170989 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 223/435] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:28 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:28.248036 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:28.249016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:28.258916 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:28.259604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:28.260688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:28.261310 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:28.396494 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:28.405247 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-35c80d85-6979-4a65-8da8-888cea5856c4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.163072 Jul 02 03:38:28.405791 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 213/436] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:28 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:28.799472 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-24ff48fd-9137-4fdf-a3df-d4546f263c1c req-43dd6f86-bbb7-4c5c-ad4c-6f192123625b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671321a8-96a7-4fc0-96b1-0fd9b12dc028", "name": "network-vif-plugged", "status": "completed", "tag": "bb25a94a-0fca-42e7-a4a5-8f6b9068b426"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:28.808767 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-24ff48fd-9137-4fdf-a3df-d4546f263c1c req-43dd6f86-bbb7-4c5c-ad4c-6f192123625b service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:28.809287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-24ff48fd-9137-4fdf-a3df-d4546f263c1c req-43dd6f86-bbb7-4c5c-ad4c-6f192123625b service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:28.822334 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-24ff48fd-9137-4fdf-a3df-d4546f263c1c req-43dd6f86-bbb7-4c5c-ad4c-6f192123625b service nova] Creating event network-vif-plugged:bb25a94a-0fca-42e7-a4a5-8f6b9068b426 for instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 on hv-cinder-84684 Jul 02 03:38:28.828287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-24ff48fd-9137-4fdf-a3df-d4546f263c1c req-43dd6f86-bbb7-4c5c-ad4c-6f192123625b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032817 Jul 02 03:38:28.829410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 224/437] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:38:29.188761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:29.189362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:29.196300 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:29.196747 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:29.197567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:29.198020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:29.339737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:29.350165 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:29.352584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:29.354493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-200bd4a8-f60d-4e11-9f0c-5cac4c8d8139 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.169371 Jul 02 03:38:29.355282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 214/438] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:29 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:29.427811 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:29.428788 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:29.438191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:29.438636 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:29.439431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:29.439867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:29.583025 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:29.592844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1c7e38bb-b56a-4c50-a614-05a79059f02d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.172978 Jul 02 03:38:29.593408 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 225/439] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:29 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:30.382679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:30.383513 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:30.387454 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=34 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:30.396624 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:30.397397 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:30.398650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:30.399363 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:30.539921 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:30.548838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:30.550376 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:30.551571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c6420eb7-b53b-4b40-ab50-1f7b8ee1cb24 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.175668 Jul 02 03:38:30.552129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 215/440] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:30 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:30.609904 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:30.610508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:30.616940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:30.617382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:30.618141 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:30.618570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:30.749190 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:30.758969 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-47082f77-441c-4cd8-a846-c087babd60f5 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1364 microversion: 2.1 time: 0.152991 Jul 02 03:38:30.759634 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 226/441] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:30 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:31.573864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:31.574793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:31.582208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:31.582651 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:31.583424 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:31.583889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:31.722719 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:31.730766 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:31.732550 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:31.733707 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-54f066ca-099c-476f-b621-3093d68f9e55 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.166427 Jul 02 03:38:31.734252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 216/442] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:31 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:31.777254 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:31.777842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:31.784861 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:31.785313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:31.786067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:31.786544 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:31.926212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:31.933895 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0bd62b45-bbaa-4696-b51b-9f13d18a1e21 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1555 microversion: 2.1 time: 0.160632 Jul 02 03:38:31.934436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 227/443] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:38:31 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:38:31.951344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5a8689d0-b9de-4a22-9cc8-3ad320027375 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:31.951874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5a8689d0-b9de-4a22-9cc8-3ad320027375 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:31.958263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a8689d0-b9de-4a22-9cc8-3ad320027375 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:31.958713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a8689d0-b9de-4a22-9cc8-3ad320027375 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:31.959525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a8689d0-b9de-4a22-9cc8-3ad320027375 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:31.959953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5a8689d0-b9de-4a22-9cc8-3ad320027375 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:32.040288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5a8689d0-b9de-4a22-9cc8-3ad320027375 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093040 Jul 02 03:38:32.040865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 217/444] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:38:31 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:38:32.752571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:32.753177 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:32.760080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:32.760533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:32.761314 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:32.761739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:32.894988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:32.903538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:32.905065 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:32.906326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a6a6ab07-5141-4b33-8fda-63346ed5e9d0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.157859 Jul 02 03:38:32.906800 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 228/445] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:32 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:33.334391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-e9a1c5dc-a2cb-43bb-8cc4-a95429b0fe7e req-406959cb-dc02-4b52-a73d-82733e172b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671321a8-96a7-4fc0-96b1-0fd9b12dc028", "tag": "bb25a94a-0fca-42e7-a4a5-8f6b9068b426"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:33.342895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-e9a1c5dc-a2cb-43bb-8cc4-a95429b0fe7e req-406959cb-dc02-4b52-a73d-82733e172b91 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:33.343485 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-e9a1c5dc-a2cb-43bb-8cc4-a95429b0fe7e req-406959cb-dc02-4b52-a73d-82733e172b91 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:33.354545 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-e9a1c5dc-a2cb-43bb-8cc4-a95429b0fe7e req-406959cb-dc02-4b52-a73d-82733e172b91 service nova] Creating event network-changed:bb25a94a-0fca-42e7-a4a5-8f6b9068b426 for instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 on hv-cinder-84684 Jul 02 03:38:33.359651 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-e9a1c5dc-a2cb-43bb-8cc4-a95429b0fe7e req-406959cb-dc02-4b52-a73d-82733e172b91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029466 Jul 02 03:38:33.360536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 218/446] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:38:33.925038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:33.925654 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:33.931997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:33.932450 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:33.933220 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:33.933692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:34.068568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:34.077648 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:34.079147 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:34.080355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6f38ac46-66a7-4fcf-86da-3596336b278c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.159266 Jul 02 03:38:34.080885 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 229/447] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:33 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:35.107844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:35.108538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:35.115227 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:35.115710 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:35.116481 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:35.116919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:35.246658 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:35.255162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:35.256673 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:35.257831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-76ef5548-ad84-4511-aad7-ff6968656f56 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.157642 Jul 02 03:38:35.258382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 219/448] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:35 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:36.284372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:36.285369 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:36.296290 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:36.297033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:36.298317 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:36.299033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:36.445600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:36.454911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:36.456431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:36.457591 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1f2d3095-6a1f-4f2b-98b1-b2353a0a674f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.180248 Jul 02 03:38:36.458172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 230/449] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:36 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:37.476565 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:37.477125 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:37.484711 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:37.485163 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:37.485931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:37.486366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:37.634655 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:37.644292 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:37.645769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:37.647241 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8372ea5b-82ec-4623-b0ba-40f2ceb36ada tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.174682 Jul 02 03:38:37.647820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 220/450] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:37 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:38.670620 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:38.671595 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:38.681985 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:38.682753 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:38.684082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:38.685030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:38.704739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:38.821499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:38.829869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:38.831386 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:38.832548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-779b4181-90a8-46dc-b78a-16c5b6ecfa83 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.169118 Jul 02 03:38:38.833112 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 231/451] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:38 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:39.855334 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:39.856253 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:39.867690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:39.868423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:39.869718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:39.870443 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:40.008201 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:40.016869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:40.018342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:40.019527 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6cd34c4a-13d2-45f7-83f6-8d93bf231aff tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.170865 Jul 02 03:38:40.020087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 221/452] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:39 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:41.041760 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:41.042739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:41.051033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:41.051511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:41.052274 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:41.052739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:41.196142 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:41.204795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:41.206298 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:41.207505 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4b891e97-d824-4696-958b-11d85eabafde tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.172237 Jul 02 03:38:41.208070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 232/453] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:41 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:42.228284 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:42.228826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:42.237901 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:42.238460 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:42.239609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:42.240088 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:42.383913 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:42.393043 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:42.394948 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:42.396133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-30593dcb-2a5b-4116-89bb-31d282975075 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.173694 Jul 02 03:38:42.396659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 222/454] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:42 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:43.420843 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:43.421829 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:43.428814 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:43.429264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:43.430056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:43.430484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:43.573800 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:43.582837 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:43.584417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:43.585597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-298e90c4-0cc7-4bba-8bc4-f948398aaaac tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.173194 Jul 02 03:38:43.586156 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 233/455] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:43 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:44.609476 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:44.610402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:44.618614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:44.619074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:44.620017 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:44.620597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:44.769202 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:44.778137 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:44.779700 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:44.780889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f4295363-371b-43b0-8dfe-9b3c211689e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.179229 Jul 02 03:38:44.781448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 223/456] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:44 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:45.805050 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:45.805900 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:45.812640 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:45.813103 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:45.813867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:45.814308 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:45.952773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:45.965158 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:45.967422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:45.969209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4838ab56-2286-4803-9040-1e9a774c57f4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.168123 Jul 02 03:38:45.969851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 234/457] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:45 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:46.989950 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:46.990548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:46.997608 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:46.998060 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:46.998848 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:46.999319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:47.132608 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:47.141393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:47.142878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:47.144356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-bdf61c65-3416-4981-a8ce-53603c339051 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.159122 Jul 02 03:38:47.144889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 224/458] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:46 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:48.162330 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:48.162940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:48.164856 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:48.170720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:48.171166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:48.171939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:48.172371 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:48.313563 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:48.321969 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:48.323495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:48.324623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5bfd85be-5683-4be3-8303-afa7b84f51ad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.166385 Jul 02 03:38:48.325180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 235/459] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:48 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:49.350031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:49.351025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:49.362369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:49.362794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:49.363621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:49.364054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:49.379851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:49.497471 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:49.508068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:49.509538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:49.510703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-33a5c3f9-6753-422c-b995-709a43d5fa6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.167598 Jul 02 03:38:49.511326 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 225/460] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:49 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:50.299477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-a84d9754-0c0e-4cac-876e-1c305ccdaebf req-1104a12f-0b94-4be0-9d37-71cd1b9e4d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2d5a1f-4e5b-4072-851a-d01f23742f55", "name": "network-vif-plugged", "status": "completed", "tag": "01f88803-1998-4eea-820a-bbda30202ac5"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:38:50.307880 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-a84d9754-0c0e-4cac-876e-1c305ccdaebf req-1104a12f-0b94-4be0-9d37-71cd1b9e4d70 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:50.308627 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-a84d9754-0c0e-4cac-876e-1c305ccdaebf req-1104a12f-0b94-4be0-9d37-71cd1b9e4d70 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:50.320754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-a84d9754-0c0e-4cac-876e-1c305ccdaebf req-1104a12f-0b94-4be0-9d37-71cd1b9e4d70 service nova] Creating event network-vif-plugged:01f88803-1998-4eea-820a-bbda30202ac5 for instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 on hv-cinder-84684 Jul 02 03:38:50.325975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-a84d9754-0c0e-4cac-876e-1c305ccdaebf req-1104a12f-0b94-4be0-9d37-71cd1b9e4d70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030296 Jul 02 03:38:50.326658 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 236/461] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:38:50.529230 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:50.529829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:50.536576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:50.537009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:50.537978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:50.538437 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:50.903984 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:50.912501 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:50.913997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:50.915156 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ffaa90f6-e9ce-4f50-b442-8548e8fc66e8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.389844 Jul 02 03:38:50.915723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 226/462] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:50 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:51.941792 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:51.942363 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:51.949141 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:51.949587 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:51.950476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:51.950753 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:52.089943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:52.098716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:52.100264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:52.101426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d9c5cc5d-d60e-43fe-84f1-78e45e8044fc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.166755 Jul 02 03:38:52.101982 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 237/463] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:51 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:53.105186 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:38:53.106128 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Sat Jul 2 03:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:38:53.119916 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:53.120520 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:53.127479 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:53.127927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:53.128682 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:53.129238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:53.284405 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:53.292842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:53.294664 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:53.295855 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d3bd5842-5b48-426d-a2cb-9279ee80a1a8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.179758 Jul 02 03:38:53.296399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 227/464] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:53 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:54.317694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:54.318236 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:54.324665 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:54.325106 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:54.325864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:54.326291 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:54.460751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:54.468752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:54.470364 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:54.471551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9cc79e69-fdaf-49a1-bfd4-eaa356fe4b5f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.160380 Jul 02 03:38:54.472109 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 238/465] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:54 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:55.495016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:55.496009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:55.506134 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:55.506637 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:55.507553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:55.507992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:55.641705 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:55.654331 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:55.656754 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:55.658343 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ef650699-743e-4442-a08f-eb148a7933bd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.170383 Jul 02 03:38:55.659211 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 228/466] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:55 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:56.681533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:56.682588 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:56.693356 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:56.694170 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:56.694949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:56.695416 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:56.835434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:56.843888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:56.845396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:56.846555 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-eb0baa6a-183c-44a8-96c9-16b2710bc3bb tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1745 microversion: 2.20 time: 0.171562 Jul 02 03:38:56.847129 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 239/467] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:56 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:38:57.868311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:57.869141 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:57.877975 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:57.878511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:57.879421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:57.879925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:58.021486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:58.031210 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:58.033139 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:58.035283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1e81f07a-0004-4ca3-bc12-c8b2049ecc7e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.171158 Jul 02 03:38:58.036204 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 229/468] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:57 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:38:59.058454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:38:59.059834 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:38:59.071571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:59.072316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:59.073359 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:38:59.074014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:38:59.230229 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:59.238852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:59.240389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:38:59.242235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-05d685bf-1d6b-4705-9920-644f9a48f64c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.189136 Jul 02 03:38:59.242781 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 240/469] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:38:59 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:00.215084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:00.215722 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:00.225623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:00.226307 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:00.227424 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:00.228031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:00.261137 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:00.261770 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:00.268366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:00.268807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:00.269586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:00.270016 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:00.392145 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lazy-loading 'services' on Instance uuid 0004653b-9bc7-4d42-a7af-51f8b04352b8 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:39:00.411931 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:00.422432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:00.424309 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:00.425743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1390ef8c-df5f-481d-a71c-c776dc54a5a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.169391 Jul 02 03:39:00.426445 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 241/470] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:00 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:00.610164 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-621ef3d5-0a1b-436b-8dda-ca9ac4d58621 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8/os-volume_attachments/03f07c00-755d-4289-8587-1bbf2db2ab21" status: 202 len: 0 microversion: 2.1 time: 0.399743 Jul 02 03:39:00.611387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 230/471] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:39:00 2022] DELETE /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8/os-volume_attachments/03f07c00-755d-4289-8587-1bbf2db2ab21 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:39:01.446813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:01.447606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:01.454047 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:01.454559 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:01.455450 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:01.455977 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:01.604773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:01.613289 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:01.614771 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:01.616065 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2165ee18-5800-479c-b393-54fd64a7957c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.173986 Jul 02 03:39:01.616727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 242/472] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:01 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:02.641923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:02.642630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:02.645351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=32 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:02.653953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:02.654549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:02.655287 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:02.655812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:02.824695 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:02.825256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:02.832160 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:02.832696 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:02.833538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:02.834038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:02.837491 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:02.846406 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:02.848248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:02.849419 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-92c7a514-599d-435b-ae5e-6a262c3acca9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.213778 Jul 02 03:39:02.860640 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 231/473] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:02 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:02.873655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:39:02.962055 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d91ed119-3644-4fee-995f-2e346ffdfebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 204 len: 0 microversion: 2.1 time: 0.143279 Jul 02 03:39:02.964048 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 243/474] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:39:02 2022] DELETE /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:39:02.972456 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:02.973573 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:02.980535 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:02.981308 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:02.982647 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:02.983288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:03.136695 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:03.145015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-019f5fa9-0325-4cf8-89b3-14ddc8f0312b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1514 microversion: 2.1 time: 0.176600 Jul 02 03:39:03.145913 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 232/475] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:02 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:03.870256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:03.871466 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:03.878736 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:03.879511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:03.880947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:03.881613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:04.043427 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:04.051777 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:04.053357 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:04.054522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-68f57223-8495-41b5-aa0e-a53457e96398 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.189731 Jul 02 03:39:04.055275 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 244/476] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:03 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:04.162146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:04.162841 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:04.170478 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:04.170938 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:04.171742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:04.172190 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:04.320953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:04.330951 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-87a58796-9249-49b3-81e5-58d7e4c13d1e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1514 microversion: 2.1 time: 0.172297 Jul 02 03:39:04.331961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 233/477] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:04 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:05.073106 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:05.074743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:05.081150 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:05.081688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:05.082540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:05.083032 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:05.261680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:05.270571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:05.272348 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:05.273688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d60012b1-6738-4e2b-9ec3-8f2fde8a5b66 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.204937 Jul 02 03:39:05.277412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 245/478] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:05 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:05.347060 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:05.348040 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:05.355037 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:05.355528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:05.356312 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:05.357206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:05.531507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:05.544209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c66dae76-03a8-46b6-88af-ea44b3848c7d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 200 len: 1514 microversion: 2.1 time: 0.200957 Jul 02 03:39:05.547348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 234/479] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:05 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:05.914296 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-9b3439ca-a4be-468b-b921-389f36072753 req-61fd29c3-ace8-4747-ad14-10989675ac03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0004653b-9bc7-4d42-a7af-51f8b04352b8", "name": "network-vif-deleted", "tag": "7c96ddc8-ca7b-4f34-8c1f-5998b91f662b"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:05.924222 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-9b3439ca-a4be-468b-b921-389f36072753 req-61fd29c3-ace8-4747-ad14-10989675ac03 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:05.924667 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-9b3439ca-a4be-468b-b921-389f36072753 req-61fd29c3-ace8-4747-ad14-10989675ac03 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:05.937148 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-9b3439ca-a4be-468b-b921-389f36072753 req-61fd29c3-ace8-4747-ad14-10989675ac03 service nova] Creating event network-vif-deleted:7c96ddc8-ca7b-4f34-8c1f-5998b91f662b for instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 on hv-cinder-84684 Jul 02 03:39:05.942191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-9b3439ca-a4be-468b-b921-389f36072753 req-61fd29c3-ace8-4747-ad14-10989675ac03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Jul 02 03:39:05.946385 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 246/480] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:39:06.294084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:06.294701 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:06.302120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:06.303630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:06.304866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:06.305610 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:06.463532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:06.474755 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:06.476349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:06.482422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9112de96-dcf3-4f62-ab9b-6b9a8869edb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.189971 Jul 02 03:39:06.498585 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 235/481] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:06 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:06.562196 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:06.562959 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 0004653b-9bc7-4d42-a7af-51f8b04352b8] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:06.574291 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:06.575139 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:06.576043 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:06.576692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:06.591622 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] HTTP exception thrown: Instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 could not be found. Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Request method failure captured: Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 HTTP/1.1 Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv72GEtepMdNfLmrbuviXb_FkkXZ0P0RwS0qLh8NWGRcD0PuT4khLgyDx_pOpH466JfAlIeY8vMR52V2dFqUx5q2O5f-YjgP7drZOGIGYa1XfoaobRAXAu0_qsb57mH7f0u-kQVh05loXR-L0XWRYjXHCDjyhN_7rZD70lP1TdAtrL2A Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 8eba05f9e3a8402f96924c5c715229a5 Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesSnapshotTestJSON-164239314 Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:39:06.593440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8eba05f9e3a8402f96924c5c715229a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8eba05f9e3a8402f96924c5c715229a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8eba05f9e3a8402f96924c5c715229a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8eba05f9e3a8402f96924c5c715229a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesSnapshotTestJSON-164239314 Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 8eba05f9e3a8402f96924c5c715229a5 Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-164239314 Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesSnapshotTestJSON-164239314-project Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: a6346c2aa3ab4ebabd9bbd0b9c441ad3 Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesSnapshotTestJSON-164239314-project Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 could not be found. Jul 02 03:39:06.595022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '0004653b-9bc7-4d42-a7af-51f8b04352b8'} Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 could not be found. Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:39:06.595921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 could not be found. Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 could not be found. Jul 02 03:39:06.597460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:39:06.598759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Returning 404 to user: Instance 0004653b-9bc7-4d42-a7af-51f8b04352b8 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:39:06.598759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1143cd41-2358-4c76-8fd3-a10695097005 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8" status: 404 len: 111 microversion: 2.1 time: 0.038101 Jul 02 03:39:06.598759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 247/482] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:06 2022] GET /compute/v2.1/servers/0004653b-9bc7-4d42-a7af-51f8b04352b8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:39:07.506324 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:07.507240 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:07.514537 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:07.515244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:07.516328 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:07.516751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:07.669064 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:07.677388 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:07.678939 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:07.680324 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dd168003-4fed-43ef-9669-1df3c6fa8c92 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.178235 Jul 02 03:39:07.690790 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 236/483] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:07 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:08.699268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:08.699929 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:08.706522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:08.706990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:08.707814 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:08.708252 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:08.724217 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:08.844751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:08.853701 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:08.855199 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:08.856419 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7391caff-236e-4555-a1ad-ac8b41d581f5 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.161318 Jul 02 03:39:08.856942 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 248/484] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:08 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:09.882539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:09.884368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:09.895521 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:09.896261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:09.897349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:09.897793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:10.033761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:10.045748 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:10.048101 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:10.049762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-33490d04-54dc-4131-bef6-d383fd8e30b8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.173364 Jul 02 03:39:10.050519 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 237/485] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:09 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:11.078926 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:11.079936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:11.090613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:11.091465 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:11.092679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:11.093394 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:11.230877 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:11.239274 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:11.241181 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:11.242351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-08471f57-c690-4307-9639-d0b540b3b0e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1740 microversion: 2.20 time: 0.169981 Jul 02 03:39:11.242910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 249/486] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:11 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:12.260656 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:12.261231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:12.268422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:12.268867 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:12.269628 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:12.270057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:12.409566 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:12.418472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:12.421107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:12.422590 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6127ea69-1618-4cf7-a597-fed898d0caa2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1722 microversion: 2.20 time: 0.165776 Jul 02 03:39:12.423280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 238/487] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:12 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:13.445096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:13.446291 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:13.456739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:13.457537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:13.458939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:13.459731 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:13.592013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:13.605408 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:13.607767 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:13.609404 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6b42fe5c-3ca2-400c-afa5-138d81ad1f85 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1722 microversion: 2.20 time: 0.171196 Jul 02 03:39:13.609987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 250/488] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:13 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:14.631760 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:14.632592 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:14.641444 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:14.642009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:14.642991 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:14.643586 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:14.784115 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:14.793095 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:14.794570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:14.795737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e9ce09b7-e1f2-4e55-b065-21569893cba0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1722 microversion: 2.20 time: 0.170429 Jul 02 03:39:14.796287 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 239/489] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:14 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:15.287707 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-488c4e25-5584-4347-bd75-b31cf134afc5 req-dc78856a-b910-407a-8d9d-7c60ec2966d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2d5a1f-4e5b-4072-851a-d01f23742f55", "name": "network-vif-unplugged", "status": "completed", "tag": "01f88803-1998-4eea-820a-bbda30202ac5"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:15.296367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-488c4e25-5584-4347-bd75-b31cf134afc5 req-dc78856a-b910-407a-8d9d-7c60ec2966d7 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:15.296823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-488c4e25-5584-4347-bd75-b31cf134afc5 req-dc78856a-b910-407a-8d9d-7c60ec2966d7 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:15.308996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-488c4e25-5584-4347-bd75-b31cf134afc5 req-dc78856a-b910-407a-8d9d-7c60ec2966d7 service nova] Creating event network-vif-unplugged:01f88803-1998-4eea-820a-bbda30202ac5 for instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 on hv-cinder-84684 Jul 02 03:39:15.314011 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-488c4e25-5584-4347-bd75-b31cf134afc5 req-dc78856a-b910-407a-8d9d-7c60ec2966d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030479 Jul 02 03:39:15.314597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 251/490] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:39:15.817969 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:15.818957 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:15.829915 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:15.830660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:15.832002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:15.832766 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:15.985770 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:15.994354 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:15.995864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:15.997031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3f1dab7e-7784-4633-a9d5-bd2f5721b004 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1722 microversion: 2.20 time: 0.185536 Jul 02 03:39:15.997618 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 240/491] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:15 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:17.018386 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:17.019282 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:17.027831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:17.028422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:17.029427 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:17.029998 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:17.168975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:17.180307 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:17.181797 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:17.182951 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3973d86c-e591-4ec8-90f4-a6cd555e9ae6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1722 microversion: 2.20 time: 0.170344 Jul 02 03:39:17.183646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 252/492] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:17 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:18.201989 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:18.202757 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:18.209170 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:18.209601 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:18.210372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:18.210829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:18.233713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:18.359977 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:18.372939 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:18.375265 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:18.377158 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cb7e089a-b140-4a8e-96a4-bb94dbb82f87 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1722 microversion: 2.20 time: 0.180098 Jul 02 03:39:18.378026 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 241/493] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:18 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:18.623660 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1102076105", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "networks": [{"uuid": "ffa95e81-0ba1-4cca-87ba-54c202a4f9a5"}]}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:18.630234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:18.676820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] validate_networks() for [('ffa95e81-0ba1-4cca-87ba-54c202a4f9a5', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:39:19.044529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:39:19.045056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:39:19.045507 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:39:19.045940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:39:19.046349 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:39:19.056028 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:19.056482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:19.057299 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:19.057799 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:19.075703 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Getting quotas for project 8eba05f9e3a8402f96924c5c715229a5. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:39:19.080746 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Getting quotas for user a6346c2aa3ab4ebabd9bbd0b9c441ad3 and project 8eba05f9e3a8402f96924c5c715229a5. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:39:19.092385 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:39:19.094648 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:39:19.141640 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9e5f837a-8c63-4716-b96e-e18f8220e05c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521947 Jul 02 03:39:19.142337 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 253/494] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:39:19.152444 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-03895036-9fc7-430f-850f-94ad3d3602ba tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:19.153047 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-03895036-9fc7-430f-850f-94ad3d3602ba tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:19.212787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-03895036-9fc7-430f-850f-94ad3d3602ba tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:19.222696 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-03895036-9fc7-430f-850f-94ad3d3602ba tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1219 microversion: 2.1 time: 0.074090 Jul 02 03:39:19.223646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 242/495] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:19 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:19.395166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:19.395817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:19.402885 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:19.403371 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:19.404174 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:19.404618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:19.550956 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:19.559344 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:19.560827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:19.562321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0d2e88bf-497a-4be0-9e3a-a41fe40ce73b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1665 microversion: 2.20 time: 0.171020 Jul 02 03:39:19.562945 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 254/496] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:19 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:19.580383 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-92c763bd-5a9c-44b4-8b3d-f8c0c88171fd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41b9f6b7-c9d3-40ae-9a4f-da48642a778f"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:19.581418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-92c763bd-5a9c-44b4-8b3d-f8c0c88171fd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:19.588802 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c763bd-5a9c-44b4-8b3d-f8c0c88171fd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:19.589262 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c763bd-5a9c-44b4-8b3d-f8c0c88171fd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:19.590042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c763bd-5a9c-44b4-8b3d-f8c0c88171fd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:19.590486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-92c763bd-5a9c-44b4-8b3d-f8c0c88171fd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:19.910798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-92c763bd-5a9c-44b4-8b3d-f8c0c88171fd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.334516 Jul 02 03:39:19.911665 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 243/497] 10.222.0.42 () {62 vars in 1363 bytes} [Sat Jul 2 03:39:19 2022] POST /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:39:20.029362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-eff0a6c7-08a0-4ed9-9e7f-1b3fd9723669 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:20.029882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-eff0a6c7-08a0-4ed9-9e7f-1b3fd9723669 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:20.036404 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eff0a6c7-08a0-4ed9-9e7f-1b3fd9723669 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:20.036833 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eff0a6c7-08a0-4ed9-9e7f-1b3fd9723669 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:20.037596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eff0a6c7-08a0-4ed9-9e7f-1b3fd9723669 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:20.038032 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eff0a6c7-08a0-4ed9-9e7f-1b3fd9723669 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:20.133071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-eff0a6c7-08a0-4ed9-9e7f-1b3fd9723669 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/action" status: 202 len: 0 microversion: 2.20 time: 0.107706 Jul 02 03:39:20.134524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 255/498] 10.222.0.42 () {62 vars in 1318 bytes} [Sat Jul 2 03:39:20 2022] POST /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:39:20.142981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:20.143911 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:20.150526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:20.150964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:20.151758 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:20.152206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:20.241621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:20.242623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:20.249840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:20.250797 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:20.251848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:20.252524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:20.301831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:20.310551 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:20.312062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:20.314623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b3eb62a4-e93b-4eb3-b09d-f3ea80ac620c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1751 microversion: 2.20 time: 0.175712 Jul 02 03:39:20.323889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 244/499] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:20 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:20.350511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:20.358505 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-19aa92a5-a41f-4786-b988-0aeac29d92e9 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1279 microversion: 2.1 time: 0.121926 Jul 02 03:39:20.359568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 256/500] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:20 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:39:21.342280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:21.342842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:21.349541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:21.349991 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:21.350897 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:21.351338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:21.377417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:21.378666 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:21.396669 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:21.397386 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:21.398362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:21.412135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:21.528024 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:21.540018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:21.542468 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:21.544690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-29faaa5a-818b-4975-9f89-e5351ccaaa62 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1751 microversion: 2.20 time: 0.206654 Jul 02 03:39:21.555380 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 245/501] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:21 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:21.634950 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:21.642639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-464a8c5d-7684-4a70-a00a-8dbd035ad3cf tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.269037 Jul 02 03:39:21.643664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 257/502] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:21 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:39:21.725003 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-0996db59-bba8-4394-8d52-36bdd51f9210 req-4442b121-362d-4ecf-a190-d3441464972a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0513dd-d098-4c32-a5fd-4e2f036dfe99", "tag": "944c1aac-d4ef-42f2-9807-2800ed34d6b9"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:21.734442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-0996db59-bba8-4394-8d52-36bdd51f9210 req-4442b121-362d-4ecf-a190-d3441464972a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:21.735315 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-0996db59-bba8-4394-8d52-36bdd51f9210 req-4442b121-362d-4ecf-a190-d3441464972a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:21.749603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-0996db59-bba8-4394-8d52-36bdd51f9210 req-4442b121-362d-4ecf-a190-d3441464972a service nova] Creating event network-changed:944c1aac-d4ef-42f2-9807-2800ed34d6b9 for instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 on hv-cinder-84684 Jul 02 03:39:21.754531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-0996db59-bba8-4394-8d52-36bdd51f9210 req-4442b121-362d-4ecf-a190-d3441464972a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034825 Jul 02 03:39:21.755124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 246/503] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:39:22.566727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:22.567355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:22.576464 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:22.577103 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:22.578232 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:22.578735 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:22.661866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:22.662286 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:22.669563 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:22.670376 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:22.671161 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:22.671635 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:22.722757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:22.731806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:22.733400 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:22.734616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-59b9cc2f-ae63-454b-8253-1b55ad38db4a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1753 microversion: 2.20 time: 0.173467 Jul 02 03:39:22.735183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 258/504] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:22 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:22.806681 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:22.814249 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d21acbb6-9adc-4b4e-9452-07fa552b3b6f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.157592 Jul 02 03:39:22.814834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 247/505] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:22 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:23.753626 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:23.754228 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:23.762204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:23.762943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:23.764480 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:23.765214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:23.832625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:23.833319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:23.840726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:23.841151 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:23.841935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:23.842381 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:23.954180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:23.963845 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:23.965338 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:23.966487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-458c8b21-0aac-4676-9913-06596dd8de40 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1753 microversion: 2.20 time: 0.216832 Jul 02 03:39:23.967040 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 259/506] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:23 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1753 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:23.998841 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:24.007002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1e149b01-2a8a-4084-9038-096276bab059 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.178496 Jul 02 03:39:24.007586 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 248/507] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:23 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:24.988514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:24.989106 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:24.997816 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:24.998448 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:24.999317 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:24.999918 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:25.024208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:25.024797 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:25.031561 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:25.031977 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:25.032990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:25.033414 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:25.194798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:25.206516 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:25.208230 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:25.209790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6ea723df-7cce-4b65-ba60-07439c222781 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1753 microversion: 2.20 time: 0.227124 Jul 02 03:39:25.210435 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 260/508] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:24 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1753 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:25.221213 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:25.222673 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-bf33656e-ec64-4840-a7e1-120ce2aa0b47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.202431 Jul 02 03:39:25.223269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 249/509] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:25 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:26.227993 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:26.228791 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:26.234802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:26.235277 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:26.236062 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:26.236493 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:26.239870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:26.240455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:26.247068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:26.247540 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:26.248329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:26.248762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:26.437913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:26.445788 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:26.448234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:26.450052 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:26.451259 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a3f212a8-84bd-4e2a-9fb3-07ae0160727e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.227190 Jul 02 03:39:26.451840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 261/510] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:26 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:39:26.457604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dcfb3594-23b0-471f-96d0-4d8bc272b197 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.218785 Jul 02 03:39:26.457604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 250/511] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:26 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:27.097603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-594e3d3e-9a83-4862-982f-2db19028caba req-55866bf2-a4cd-4051-a655-1883a25dce61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0513dd-d098-4c32-a5fd-4e2f036dfe99", "name": "network-vif-plugged", "status": "completed", "tag": "944c1aac-d4ef-42f2-9807-2800ed34d6b9"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:27.109645 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-594e3d3e-9a83-4862-982f-2db19028caba req-55866bf2-a4cd-4051-a655-1883a25dce61 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:27.110070 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-594e3d3e-9a83-4862-982f-2db19028caba req-55866bf2-a4cd-4051-a655-1883a25dce61 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:27.121966 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-594e3d3e-9a83-4862-982f-2db19028caba req-55866bf2-a4cd-4051-a655-1883a25dce61 service nova] Creating event network-vif-plugged:944c1aac-d4ef-42f2-9807-2800ed34d6b9 for instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 on hv-cinder-84684 Jul 02 03:39:27.130554 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-594e3d3e-9a83-4862-982f-2db19028caba req-55866bf2-a4cd-4051-a655-1883a25dce61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Jul 02 03:39:27.130554 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 251/512] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:39:27.469893 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:27.471423 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:27.472675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:27.473376 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:27.481205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:27.481742 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:27.482581 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:27.483014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:27.489069 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:27.489515 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:27.490311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:27.490741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:27.655790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:27.666681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:27.669261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:27.670525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-015fa5be-2012-482d-b9e5-4405ea367366 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.204806 Jul 02 03:39:27.682308 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 262/513] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:27 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:27.714068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:27.721610 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0f6d2ffa-3082-413e-97e9-c1e14fb762d4 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.253663 Jul 02 03:39:27.722098 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 252/514] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:27 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:28.690519 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:28.691224 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:28.698846 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:28.699523 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:28.700309 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:28.700741 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:28.737925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:28.739147 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:28.746622 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:28.747323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:28.748274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:28.748864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:28.922367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:28.926433 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:28.930798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:28.932428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:28.933583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-636a2803-25ab-470b-b511-d3f7818e4595 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.247290 Jul 02 03:39:28.934134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 263/515] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:28 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:28.934281 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7a854c13-c05b-4e6b-95ab-859e4dee3b54 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.200130 Jul 02 03:39:28.934751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 253/516] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:28 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:39:29.951891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:29.952428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:29.952739 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:29.954434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:29.955075 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=6 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:29.963257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:29.963760 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:29.964570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:29.965014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:30.078591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:30.079209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:30.086163 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:30.086619 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:30.087750 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:30.088426 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:30.106342 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:30.114212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-effaafc1-a055-40cb-ad0d-aa38c7b2db2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.166402 Jul 02 03:39:30.114705 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 264/517] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:29 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:30.221797 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:30.230689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:30.232208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:30.233369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cf7845a5-6b86-47c8-81d6-7d7121fbdc8d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.285279 Jul 02 03:39:30.233926 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 254/518] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:29 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:39:31.131544 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:31.132122 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:31.140493 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:31.140877 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:31.142498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:31.142960 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:31.145702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:31.252740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:31.254807 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:31.264975 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:31.265445 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:31.266373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:31.266960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:31.298410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:31.306430 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c8d89676-1dba-47e3-b0f5-cf70da40188d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.178832 Jul 02 03:39:31.307009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 265/519] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:31 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:31.404136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:31.412689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:31.414213 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:31.415391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ca86514d-6ccb-4235-8ab3-b4ca61046c3e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.168067 Jul 02 03:39:31.415918 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 255/520] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:31 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:32.323928 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:32.325370 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:32.332185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:32.332866 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:32.333838 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:32.334268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:32.434052 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:32.434690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:32.442285 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:32.443142 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:32.444219 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:32.444748 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:32.485753 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:32.493542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d8952ee8-f839-40cc-9d0a-f07e3660fa79 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.173529 Jul 02 03:39:32.494101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 266/521] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:32 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:32.598307 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:32.608682 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:32.610286 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:32.611577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a5c062b6-1890-4545-be36-9fc60182e2a4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.181507 Jul 02 03:39:32.612217 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 256/522] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:32 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:39:33.510626 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:33.511598 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:33.517595 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:33.518040 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:33.518794 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:33.519224 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:33.630103 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:33.631714 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:33.634441 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=54 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:33.640576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:33.641048 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:33.642164 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:33.642780 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:33.657045 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:33.664694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-deb9c456-c37f-4428-967d-e377e16b243c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.158044 Jul 02 03:39:33.665265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 267/523] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:33 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:33.795346 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:33.797599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:33.805385 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:33.806859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:33.808056 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5369e732-b389-480f-8046-f5d94a184045 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.182033 Jul 02 03:39:33.808794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 257/524] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:33 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:34.682558 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:34.683214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:34.689890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:34.690340 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:34.691375 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:34.691809 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:34.828364 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:34.829004 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:34.836443 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:34.836864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:34.837626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:34.838056 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:34.847063 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:34.854768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7f96167a-327b-4c43-beb6-b5794ee62b2b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.176281 Jul 02 03:39:34.855451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 268/525] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:34 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:34.987567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:34.996303 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:34.997830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:34.999171 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3b85bf94-23f2-40f2-9fff-792aa9db4093 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.176841 Jul 02 03:39:34.999770 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 258/526] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:34 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:35.873242 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:35.873903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:35.880384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:35.880833 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:35.881595 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:35.882028 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:36.017623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:36.018243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:36.019813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:36.025264 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:36.025730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:36.026486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:36.026920 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:36.029437 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2dcb0c29-85ee-43bc-87cb-ae47a0d7886f tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.160250 Jul 02 03:39:36.030374 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 269/527] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:35 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:36.173776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:36.183754 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:36.185475 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:36.186644 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-af472821-16f2-4519-b129-dd24a3bf5bad tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.172964 Jul 02 03:39:36.187171 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 259/528] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:36 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:37.047552 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:37.048234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:37.054689 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:37.055162 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:37.055961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:37.056398 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:37.203823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:37.205275 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:37.206025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:37.211766 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-31e61a33-153d-4b0f-a92b-b4e16f74816e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.168670 Jul 02 03:39:37.212376 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 270/529] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:37 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:37.212581 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:37.212962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:37.213676 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:37.214269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:37.350870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:37.359820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:37.361535 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:37.362995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5373651a-de09-4e25-822c-314c23f0bb6c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.161745 Jul 02 03:39:37.363726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 260/530] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:37 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:39:38.228822 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:38.229483 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:38.236494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:38.236927 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:38.238149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:38.238700 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:38.377887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:38.382859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:38.383636 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:38.390731 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:38.391177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:38.391978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:38.392407 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:38.393029 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-33f1f373-e7bd-47a8-bc23-acfc92f2ef21 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.167974 Jul 02 03:39:38.393820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 271/531] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:38 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:38.536717 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:38.546130 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:38.547642 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:38.548832 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e6244ad2-0d93-499e-8105-2d04462be69e tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.170478 Jul 02 03:39:38.549620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 261/532] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:38 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:39:39.410477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:39.411088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:39.417391 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:39.418153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:39.418905 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:39.419342 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:39.555322 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:39.564141 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d4c3d1f7-4831-4e6c-ac56-bc684a2aef22 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.157629 Jul 02 03:39:39.564844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 272/533] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:39 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:39.567450 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:39.568769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:39.575918 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:39.576461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:39.577259 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:39.577704 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:39.710580 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:39.719601 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:39.721161 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:39.722429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-40a05ada-ae8c-4a8e-9573-fb360773d410 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.158932 Jul 02 03:39:39.723113 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 262/534] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:39 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:40.581891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:40.582678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:40.589363 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:40.589823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:40.590591 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:40.591024 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:40.724658 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:40.733838 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-640e9e5b-dc12-423e-bb58-cd67306fc0a8 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.156149 Jul 02 03:39:40.735608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 273/535] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:40 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:40.740805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:40.741365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:40.748484 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:40.748931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:40.749759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:40.750188 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:40.896747 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:40.905956 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:40.907529 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:40.908701 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-291f0d5c-3922-4ff5-aeb5-92089f6fe454 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.171782 Jul 02 03:39:40.909221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 263/536] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:40 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:41.755460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:41.756530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:41.766175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:41.766612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:41.767386 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:41.767822 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:41.900582 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:41.912965 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-40c543f5-d308-4c96-b080-e607e1dd9bdc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.163864 Jul 02 03:39:41.913921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 274/537] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:41 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:41.928138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:41.928716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:41.935864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:41.936318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:41.937083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:41.937504 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:42.073352 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:42.085669 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:42.087853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:42.089625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-53a5cfcd-96ec-4ef1-a460-48e5cf2cded4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.165532 Jul 02 03:39:42.090467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 264/538] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:41 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:42.935253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:42.935991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:42.943010 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:42.943491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:42.944265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:42.944687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:43.077961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:43.085442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2e6440a1-d2e6-4bcd-881b-ac2d72ab9a19 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.155248 Jul 02 03:39:43.086000 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 275/539] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:42 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:43.110928 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:43.111741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:43.121866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:43.122478 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:43.123553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:43.124236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:43.265895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:43.277925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:43.280371 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:43.282129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-55bac1df-46de-4a22-8162-965a2d24c6b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.175099 Jul 02 03:39:43.282939 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 265/540] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:43 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:44.105852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:44.107180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:44.114819 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:44.115263 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:44.116046 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:44.116474 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:44.252904 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:44.260543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0dde23e1-8bc1-448a-974d-b0dd91a22794 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.161221 Jul 02 03:39:44.261099 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 276/541] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:44 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:44.306569 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:44.307186 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:44.314809 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:44.315245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:44.316032 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:44.316493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:44.448205 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:44.460920 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:44.463162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:44.464740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-49e5e6f4-3401-4a30-aa5e-f2f618c33f44 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.162158 Jul 02 03:39:44.465485 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 266/542] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:44 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:45.281384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:45.282373 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:45.289802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:45.290242 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:45.290994 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:45.291503 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:45.442313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:45.450102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-95934e2f-5363-440e-a587-17e8ac1eaf41 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.175246 Jul 02 03:39:45.450664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 277/543] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:45 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:45.487592 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:45.488274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:45.494958 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:45.495451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:45.496216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:45.496652 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:45.631419 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:45.640550 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:45.642041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:45.643208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-36a6ae50-6ce4-4ca5-b769-0b3ba0621bd7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.162022 Jul 02 03:39:45.643792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 267/544] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:45 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:46.470626 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:46.471502 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:46.478499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:46.478935 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:46.479727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:46.480156 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:46.617949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:46.627215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ec980632-12b0-419b-9b70-9ee897026c47 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.163165 Jul 02 03:39:46.627854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 278/545] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:46 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:46.667929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:46.668555 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:46.675543 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:46.676018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:46.676786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:46.678564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:46.815164 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:46.824373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:46.825864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:46.827018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ac5ac8e5-00bd-4031-ab05-c21c420d2123 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.163349 Jul 02 03:39:46.827606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 268/546] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:46 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:47.652839 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:47.653795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:47.664652 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:47.665403 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:47.666643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:47.667388 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:47.819879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:47.827398 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ee9a2f0f-4f5c-40e5-a509-c690555c063c tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.180945 Jul 02 03:39:47.827951 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 279/547] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:47 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:47.845625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:47.846320 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:47.853109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:47.853555 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:47.854323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:47.854768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:48.194715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:48.203448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:48.204932 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:48.206092 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b27f2a44-6d71-4a99-ba7c-dfc5c20d028b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.364376 Jul 02 03:39:48.206650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 269/548] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:47 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:48.453860 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c9438900-f4b7-4938-b07c-1752d04180e9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b871a8c0-7322-4a0b-9708-d61c8f7d64f1"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:48.454987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c9438900-f4b7-4938-b07c-1752d04180e9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:48.461499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9438900-f4b7-4938-b07c-1752d04180e9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:48.461945 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9438900-f4b7-4938-b07c-1752d04180e9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:48.462704 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9438900-f4b7-4938-b07c-1752d04180e9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:48.463135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9438900-f4b7-4938-b07c-1752d04180e9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:48.785999 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:48.806915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c9438900-f4b7-4938-b07c-1752d04180e9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480718 Jul 02 03:39:48.807570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 280/549] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:39:48 2022] POST /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:39:48.843925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:48.844539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:48.851381 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:48.852043 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:48.852740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:48.853177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:48.998941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:49.007086 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0e7f7262-42a9-4a70-a252-3cb1e35b778b tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1319 microversion: 2.1 time: 0.167047 Jul 02 03:39:49.007663 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 270/550] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:48 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:49.228680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:49.229580 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:49.232419 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:49.239904 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:49.240353 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:49.241150 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:49.241607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:49.382270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:49.391157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:49.392680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:49.393827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-59f6bda8-f52a-470b-84f7-84490dabd72c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.173029 Jul 02 03:39:49.394627 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 281/551] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:49 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:50.027836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:50.028425 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:50.038178 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:50.038816 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:50.040099 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:50.040661 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:50.174270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:50.182511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3cde3a03-eb01-4775-8ee1-7a1192fb9bff tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1509 microversion: 2.1 time: 0.160964 Jul 02 03:39:50.183050 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 271/552] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:50 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:50.202732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-87e5a809-9697-4f20-9f17-d2b54a53e06e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8ab8e83-9ca6-4bc0-b269-f424d9b6d4ad", "device": "/dev/sdb"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:50.204560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-87e5a809-9697-4f20-9f17-d2b54a53e06e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:50.211575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87e5a809-9697-4f20-9f17-d2b54a53e06e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:50.212023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87e5a809-9697-4f20-9f17-d2b54a53e06e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:50.212773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87e5a809-9697-4f20-9f17-d2b54a53e06e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:50.213204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87e5a809-9697-4f20-9f17-d2b54a53e06e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:50.418752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:50.419427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:50.425890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:50.426379 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:50.427131 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:50.427650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:50.512640 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-87e5a809-9697-4f20-9f17-d2b54a53e06e tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "POST /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313844 Jul 02 03:39:50.513470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 282/553] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:39:50 2022] POST /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:39:50.574592 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:50.583494 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:50.584996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:50.586355 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-69b79e0a-8610-43fa-a1eb-f2274a5081a0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.172118 Jul 02 03:39:50.586924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 272/554] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:50 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:51.606401 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:51.607232 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:51.614570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:51.615017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:51.615874 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:51.616277 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:51.751522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:51.762418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:51.764183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:51.765336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6f7a931f-86d7-4a61-9196-bc91b41a5a75 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.164388 Jul 02 03:39:51.765901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 283/555] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:51 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:52.786239 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:52.786789 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:52.794404 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:52.794869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:52.795705 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:52.796155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:52.933675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:52.942828 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:52.944345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:52.945501 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-079808e2-e550-40be-90c1-e318d25e94d4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.164761 Jul 02 03:39:52.946047 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 273/556] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:52 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:53.971508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:53.972459 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:53.979695 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:53.980296 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:53.981252 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:53.981676 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:54.120656 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:54.129778 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:54.131329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:54.132520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fc7a6b8b-6af7-463d-b102-55e4b13d97af tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.167663 Jul 02 03:39:54.133049 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 284/557] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:53 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:55.151251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:55.151867 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:55.158882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:55.159408 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:55.160693 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:55.161131 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:55.178021 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:55.303970 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:55.312360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:55.313860 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:55.315031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7e5735db-2d75-4a3c-9090-1a10ded6715d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.167786 Jul 02 03:39:55.315631 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 274/558] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:55 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:56.332345 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:56.333200 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:56.339403 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:56.339853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:56.340679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:56.341126 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:56.389679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:56.390697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:56.397475 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:56.398507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:56.399594 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:56.400098 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:56.425467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lazy-loading 'flavor' on Instance uuid e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:39:56.477352 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:56.486818 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:56.488463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:56.489644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-03c7c7ef-2024-4237-90e7-aa7763b27486 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.161190 Jul 02 03:39:56.490206 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 285/559] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:56 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:56.553131 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a97d832f-7291-45f9-9c4b-9fe99a5e600e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/action" status: 200 len: 32 microversion: 2.1 time: 0.167415 Jul 02 03:39:56.553735 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 275/560] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:39:56 2022] POST /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:39:56.562833 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:56.563482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:56.570055 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:56.570693 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:56.571500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:56.571939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:56.707397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:56.715537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d0046138-1db5-43c2-bb10-1e7472149fe5 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.156564 Jul 02 03:39:56.716115 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 286/561] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:56 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:57.508980 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:57.509674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:57.516786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:57.517238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:57.517999 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:57.518435 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:57.668834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:57.677794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:57.679272 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:57.680671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fa3b4aac-da2e-45b1-a68f-f482ff7955a1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.176096 Jul 02 03:39:57.681221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 276/562] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:57 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:57.733227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:57.733831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:57.741177 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:57.741655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:57.742426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:57.742864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:57.803597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-864e7860-6e59-4b97-9f25-a9d4294f5544 req-e063b4b5-9daa-44b7-bd1c-2784e8e12aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2d5a1f-4e5b-4072-851a-d01f23742f55", "name": "network-vif-plugged", "status": "completed", "tag": "01f88803-1998-4eea-820a-bbda30202ac5"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:39:57.813080 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-864e7860-6e59-4b97-9f25-a9d4294f5544 req-e063b4b5-9daa-44b7-bd1c-2784e8e12aa3 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:57.813524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-864e7860-6e59-4b97-9f25-a9d4294f5544 req-e063b4b5-9daa-44b7-bd1c-2784e8e12aa3 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:57.825874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-864e7860-6e59-4b97-9f25-a9d4294f5544 req-e063b4b5-9daa-44b7-bd1c-2784e8e12aa3 service nova] Creating event network-vif-plugged:01f88803-1998-4eea-820a-bbda30202ac5 for instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 on hv-cinder-84684 Jul 02 03:39:57.831342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-864e7860-6e59-4b97-9f25-a9d4294f5544 req-e063b4b5-9daa-44b7-bd1c-2784e8e12aa3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031693 Jul 02 03:39:57.832990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 277/563] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:39:57.888503 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:57.899758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-eebc6a37-7cc2-4dca-84c6-003d2d4e71e6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.170378 Jul 02 03:39:57.900361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 287/564] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:57 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:58.703360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:58.704156 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:58.713084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:58.713679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:58.714693 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:58.715268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:58.852815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:58.861265 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:58.862724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:58.863891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3463edae-f204-4d55-bf26-30c866846896 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.167174 Jul 02 03:39:58.864610 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 278/565] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:58 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:39:58.919941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:58.920526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:58.929310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:58.929756 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:58.930509 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:58.930941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:59.071839 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:39:59.080086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-da801d39-f361-4b76-992a-4fd92a6b3232 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.166529 Jul 02 03:39:59.080644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 288/566] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:39:58 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:39:59.886595 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:39:59.887604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:39:59.897640 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:59.898084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:39:59.898831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:39:59.899259 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:00.032159 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:00.041237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:00.043059 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:00.044244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d36b4392-9ae6-43be-8a37-29efc4395f5d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.164042 Jul 02 03:40:00.044792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 279/567] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:39:59 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:40:00.097407 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:00.098016 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:00.107432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:00.107432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:00.107432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:00.107432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:00.241875 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:00.253809 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5b8f68fe-f5db-4896-9423-94f0666e54cf tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.159924 Jul 02 03:40:00.254514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 289/568] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:00 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:01.068801 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:01.069441 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:01.076989 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:01.077439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:01.078267 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:01.078732 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:01.237075 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:01.248836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:01.250712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:01.252513 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-52725cfa-4c2c-4346-be7d-85a8f83fafe2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1809 microversion: 2.20 time: 0.188622 Jul 02 03:40:01.253358 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 280/569] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:40:01 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:40:01.271755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:01.272329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:01.281210 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:01.281735 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:01.283013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:01.283703 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:01.437867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:01.446702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b15085ea-ae67-447a-81eb-fc0e794d0079 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.179321 Jul 02 03:40:01.447661 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 290/570] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:01 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:02.274594 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:02.275199 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:02.282492 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:02.282927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:02.283762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:02.284197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:02.418022 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:02.426521 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:02.428132 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:02.429290 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d40dff93-706c-4d2d-8c9d-a5651a3edac8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1796 microversion: 2.20 time: 0.158952 Jul 02 03:40:02.429846 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 281/571] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:40:02 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:40:02.465124 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:02.465644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:02.472619 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:02.473073 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:02.474035 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:02.474498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:02.606633 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:02.615253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-667ce686-75d5-45c7-9546-c7d0cadca90c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.154051 Jul 02 03:40:02.615864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 291/572] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:02 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:03.639746 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:03.640380 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:03.648465 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:03.648904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:03.649990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:03.650109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:03.799919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:03.808685 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c103d9bd-5e6c-4443-a344-147442a05b7f tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.174242 Jul 02 03:40:03.809247 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 282/573] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:03 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:40:04.827720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:04.828485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:04.836863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:04.837316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:04.838097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:04.838533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:04.984962 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:04.993359 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-896aed73-361a-4e06-96f1-b84e5e14f323 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.170394 Jul 02 03:40:04.993938 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 292/574] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:04 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:06.011545 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:06.012154 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:06.014626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=52 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:06.020436 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:06.020888 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:06.021660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:06.022101 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:06.161548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:06.170065 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-aa565fbd-f88d-4a86-b93d-f80ebbd7ec9e tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.162621 Jul 02 03:40:06.170632 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 283/575] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:06 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:07.188422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:07.189142 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:07.197775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:07.198300 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:07.199126 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:07.199685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:07.338679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:07.348637 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8d3ddb87-0809-4f50-be93-78f4836ffabd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.164855 Jul 02 03:40:07.349322 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 293/576] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:07 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:40:08.368391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:08.369090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:08.377897 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:08.378458 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:08.379678 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:08.380153 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:08.521823 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:08.530120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f3231d02-2251-43df-989f-96ff043adb5c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.167103 Jul 02 03:40:08.530697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 284/577] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:08 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:09.549624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:09.550184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:09.558633 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:09.559223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:09.560111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:09.560645 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:09.705314 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:09.714702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d359eea6-05f0-48a4-945b-c15be7a5c07b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.168958 Jul 02 03:40:09.715595 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 294/578] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:09 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:10.733960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:10.734686 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:10.741856 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:10.742296 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:10.743278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:10.743742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:10.884669 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:10.896334 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1a8f60f5-d1bb-4ea4-8583-c0542b7122bd tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.165995 Jul 02 03:40:10.906581 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 285/579] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:10 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:11.301425 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:40:11.302223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:11.309150 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:11.309596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:11.310359 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:11.310795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:11.343618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lazy-loading 'flavor' on Instance uuid 1c09baf3-acd2-45b3-bce4-9fd6b31efdac {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:40:11.346175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:11.440837 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cb5c52c8-08f9-4857-801a-6ff90d1562c5 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "POST /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac/action" status: 202 len: 0 microversion: 2.1 time: 0.143807 Jul 02 03:40:11.441540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 295/580] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:40:11 2022] POST /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:40:11.450022 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:11.450638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:11.456785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:11.457243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:11.458540 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:11.458949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:11.611843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:11.620662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0ce33ae6-c10f-4906-a9fe-d9128064f47c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.174598 Jul 02 03:40:11.621270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 286/581] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:11 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:11.915318 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:11.916077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:11.923412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:11.923924 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:11.924816 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:11.925483 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:12.066315 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:12.075624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5bb3d5ce-2af1-47d6-8c7f-3ec0b1cf8718 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.165049 Jul 02 03:40:12.076130 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 296/582] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:11 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:12.642052 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:12.642616 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:12.649814 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:12.650261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:12.651020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:12.651497 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:12.804258 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:12.812019 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-be7f2cc4-65de-4268-8b7f-45497a42a442 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.173880 Jul 02 03:40:12.812584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 287/583] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:12 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:13.095102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:13.095677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:13.105758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:13.106216 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:13.106976 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:13.107515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:13.260093 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:13.268597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cc37f012-97fa-4ad1-ba0f-2513da2d879b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.178457 Jul 02 03:40:13.269182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 297/584] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:13 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:13.831008 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:13.831772 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:13.839443 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:13.839898 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:13.840699 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:13.841105 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:13.979433 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:13.987131 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8b797083-49f9-4908-b2e5-a1fd472189cc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.160852 Jul 02 03:40:13.992964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 288/585] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:13 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:14.291172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:14.291867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:14.300604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:14.301052 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:14.302129 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:14.302594 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:14.455167 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:14.465298 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-72c49291-87d6-4b7e-aee3-93ff77ca5fb0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.178782 Jul 02 03:40:14.465913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 298/586] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:14 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:15.006707 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:15.007313 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:15.014280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:15.014531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:15.015332 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:15.015765 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:15.159655 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:15.162917 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:15.169985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7af21e42-1d22-45af-a1c9-63f224bb99c2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.168096 Jul 02 03:40:15.170558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 289/587] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:15 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:15.487100 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:15.488085 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:15.495539 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:15.495981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:15.496737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:15.497164 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:15.682651 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:15.693038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-873568ba-57b3-4ea1-9699-a046bc2642ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.212272 Jul 02 03:40:15.693605 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 299/588] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:15 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:16.189281 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:16.189977 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:16.200460 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:16.200906 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:16.201675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:16.202109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:16.349345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:16.359171 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-45154155-6c3c-4e1c-98a9-a9433edb9134 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.174499 Jul 02 03:40:16.359866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 290/589] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:16 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:16.714807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:16.715785 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:16.726223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:16.726803 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:16.727739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:16.728355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:16.888221 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:16.897299 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b1780246-03d4-465a-a8e4-cc278ec7a5bb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.189523 Jul 02 03:40:16.897848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 300/590] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:16 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:17.378622 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:17.379486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:17.386062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:17.386511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:17.387272 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:17.387732 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:17.533556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:17.548307 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cd5ccfd6-3929-4b2f-8cb5-0d74806f24e3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.173221 Jul 02 03:40:17.549045 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 291/591] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:17 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:17.914731 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:17.915351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:17.922829 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:17.923284 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:17.924078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:17.924512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:18.054203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:18.062304 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e47aac77-899a-4242-a579-15b570de88ec tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.151559 Jul 02 03:40:18.062869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 301/592] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:17 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:18.566651 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:18.567382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:18.574273 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:18.574738 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:18.575606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:18.576045 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:18.717637 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:18.725467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-13625f46-152a-4943-a0e6-b50fc13e2346 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.162816 Jul 02 03:40:18.726037 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 292/593] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:18 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:40:19.083708 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:19.084383 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:19.092204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:19.092730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:19.093624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:19.094100 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:19.227623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:19.236077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9563fa87-30d1-44be-9e59-49cd4d2210ed tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.158890 Jul 02 03:40:19.236645 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 302/594] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:19 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:19.746031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:19.746914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:19.756246 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:19.756782 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:19.757563 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:19.758005 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:19.899700 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:19.907880 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-19db06a2-2fd8-44fd-807a-c465eeb78379 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.167974 Jul 02 03:40:19.908446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 293/595] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:19 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:20.256506 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:20.257226 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:20.259852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=44 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:20.265469 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:20.266003 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:20.267418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:20.267418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:20.400466 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:20.409234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b123c0d2-acb4-46f3-b6bd-64f569b89b9c tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.158104 Jul 02 03:40:20.409806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 303/596] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:20 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:20.414488 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:20.415010 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:20.421579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:20.422028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:20.422793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:20.423225 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:20.511949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lazy-loading 'services' on Instance uuid 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:40:20.589657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f020ddda-1614-4835-9eb8-511a7bdced80 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99/os-volume_attachments/f8ab8e83-9ca6-4bc0-b269-f424d9b6d4ad" status: 202 len: 0 microversion: 2.1 time: 0.179276 Jul 02 03:40:20.590245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 294/597] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:40:20 2022] DELETE /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99/os-volume_attachments/f8ab8e83-9ca6-4bc0-b269-f424d9b6d4ad => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:40:20.925732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:20.926362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:20.932899 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:20.933276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:20.934023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:20.934604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:21.069537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:21.077448 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-041bc296-326b-47b5-bb92-c8fe5cd9aab1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.155502 Jul 02 03:40:21.078010 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 304/598] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:20 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:21.433922 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:21.435068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:21.445226 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:21.445671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:21.446459 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:21.446888 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:21.606840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:21.619364 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-da8e2725-9112-475b-bf72-c68768a25daa tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.193675 Jul 02 03:40:21.620146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 295/599] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:21 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:22.097365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:22.099659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:22.106899 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:22.107326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:22.108134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:22.108539 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:22.250199 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:22.258507 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e4875cab-602b-4490-a255-b0f5b0acc926 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.166285 Jul 02 03:40:22.259086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 305/600] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:22 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:22.637069 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:22.637669 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:22.644606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:22.645072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:22.646034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:22.646473 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:22.786297 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:22.794890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-54b8ac27-9cf9-4983-9758-1c460dd4f850 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1735 microversion: 2.1 time: 0.161798 Jul 02 03:40:22.795490 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 296/601] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:22 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:23.276503 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:23.277265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:23.284305 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.284752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.285515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.285953 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.423699 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:23.433041 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-218ae727-b504-4f23-91ad-40f918a580d2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.160816 Jul 02 03:40:23.433578 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 306/602] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:23 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:23.812012 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:23.812620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:23.814823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:23.815425 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:23.819544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.819995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.820773 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.821182 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.821504 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.821948 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.822698 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.823128 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.847795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:40:23.927495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f39aa886-7ae5-41d2-ad83-073a98f46d2d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 204 len: 0 microversion: 2.1 time: 0.116337 Jul 02 03:40:23.928168 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 307/603] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:40:23 2022] DELETE /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:40:23.936607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:23.937296 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:23.943201 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.943685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.944453 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:23.945549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:23.953146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:23.961538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a1fab11f-4d96-4f4f-a01d-674aef592bc7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1715 microversion: 2.1 time: 0.153288 Jul 02 03:40:23.962107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 297/604] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:23 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:24.016771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:24.017455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:24.023718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.024241 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.025084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.025574 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.080002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:24.082314 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:24.089037 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7e1d7aeb-4b27-43e6-ade4-2330cf3bb977 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1515 microversion: 2.1 time: 0.156476 Jul 02 03:40:24.089615 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 308/605] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:23 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:40:24.109123 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] HTTP exception thrown: Cannot 'detach_volume' instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee while it is in vm_state rescued Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Request method failure captured: Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: DELETE /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments/b871a8c0-7322-4a0b-9708-d61c8f7d64f1 HTTP/1.1 Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7y7bLzPUWFj-NGZjnUbomMq9pCCamrIuGlzdL46FEgS4ugkab4y2M6CbytxBUL8dkybAU6gDY9bUrXa1zy9U6WD5wxDq1C1uLmIU9sloFjK6V5E4AaTr6XlcaOHNRqXcACZxcYpwgyaccNXlLlp85hntILkHdL5-bxVYphqZoabe4w Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:40:24.110840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53c88ba2f03f47538ca0eaeb08ccfc07", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: c941dc00e0584666aba13263b8c1fcb8 Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:40:24.112366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Cannot 'detach_volume' instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee while it is in vm_state rescued Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'server_id': 'e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee', 'id': 'b871a8c0-7322-4a0b-9708-d61c8f7d64f1'} Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:40:24.113276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee while it is in vm_state rescued Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee while it is in vm_state rescued Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:24.114621 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Returning 409 to user: Cannot 'detach_volume' instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee while it is in vm_state rescued {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:40:24.115711 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-aa1efb58-acaf-46aa-820d-1efcb68cc5e2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments/b871a8c0-7322-4a0b-9708-d61c8f7d64f1" status: 409 len: 152 microversion: 2.1 time: 0.099739 Jul 02 03:40:24.115711 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 298/606] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:40:24 2022] DELETE /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments/b871a8c0-7322-4a0b-9708-d61c8f7d64f1 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 02 03:40:24.121451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0686229f-2713-459b-a7a8-63bbb3c44273 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:40:24.121991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0686229f-2713-459b-a7a8-63bbb3c44273 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:24.129027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0686229f-2713-459b-a7a8-63bbb3c44273 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.129482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0686229f-2713-459b-a7a8-63bbb3c44273 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.130255 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0686229f-2713-459b-a7a8-63bbb3c44273 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.130775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0686229f-2713-459b-a7a8-63bbb3c44273 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.209538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0686229f-2713-459b-a7a8-63bbb3c44273 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "POST /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/action" status: 202 len: 0 microversion: 2.1 time: 0.091746 Jul 02 03:40:24.213260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 309/607] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:40:24 2022] POST /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:40:24.218314 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:24.218922 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:24.226263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.226712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.227526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.227960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.358912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:24.369855 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-82891c87-4602-4ceb-9358-512aaed8de6b tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1723 microversion: 2.1 time: 0.155255 Jul 02 03:40:24.370468 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 299/608] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:24 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:40:24.451015 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:24.451710 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:24.458477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.459008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.459818 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:24.460250 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:24.602526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:24.611973 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-af146841-3f40-4a33-b765-dd8a27077419 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.165790 Jul 02 03:40:24.612547 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 310/609] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:24 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:25.107647 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:25.108354 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:25.117067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:25.117602 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:25.118498 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:25.119002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:25.252828 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:25.261968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-41ea6e0b-7019-4639-a079-5b897a4a2a4d tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1515 microversion: 2.1 time: 0.158895 Jul 02 03:40:25.262536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 300/610] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:25 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:25.390734 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:25.391707 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:25.401708 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:25.402409 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:25.403681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:25.404356 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:25.542804 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:25.555878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c63d0735-c67a-428d-8878-63ac398913cb tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1723 microversion: 2.1 time: 0.170659 Jul 02 03:40:25.556914 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 311/611] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:25 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:25.633245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:25.633968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:25.640720 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:25.641162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:25.641936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:25.642374 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:25.788886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:25.797218 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-34edc99d-2994-49af-80aa-060912f29076 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.168485 Jul 02 03:40:25.797900 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 301/612] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:25 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:26.284578 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:26.285597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:26.296313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:26.297066 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:26.298325 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:26.299077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:26.438748 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:26.446920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8af0ee96-79bc-40d9-8532-259f6e448742 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1515 microversion: 2.1 time: 0.168770 Jul 02 03:40:26.447529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 312/613] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:26 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:26.574189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:26.575373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:26.581947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:26.582399 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:26.583173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:26.583643 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:26.718791 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:26.727256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e86bc268-8bef-4a96-9553-6a084d884e47 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1723 microversion: 2.1 time: 0.157017 Jul 02 03:40:26.727857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 302/614] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:26 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:26.815214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:26.815821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:26.822470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:26.822921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:26.823706 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:26.824132 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:26.964155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:26.972040 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9ce13f4c-1b94-4df7-ae54-5dcf9a653bdd tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.160688 Jul 02 03:40:26.972630 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 313/615] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:26 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:27.464340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:27.465057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:27.471640 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:27.472443 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:27.473213 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:27.473648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:27.542124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:27.551351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c9f45e9c-6a57-495c-bb4e-254c455f10b0 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1473 microversion: 2.1 time: 0.091046 Jul 02 03:40:27.552643 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 303/616] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:27 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:27.594925 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-8418f7c3-16ad-488b-99e5-dfe9495116e7 req-aee51114-472d-4f87-9ac6-1d3bd5d1b6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0513dd-d098-4c32-a5fd-4e2f036dfe99", "name": "network-vif-deleted", "tag": "944c1aac-d4ef-42f2-9807-2800ed34d6b9"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:40:27.605802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-8418f7c3-16ad-488b-99e5-dfe9495116e7 req-aee51114-472d-4f87-9ac6-1d3bd5d1b6b0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:27.606773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-8418f7c3-16ad-488b-99e5-dfe9495116e7 req-aee51114-472d-4f87-9ac6-1d3bd5d1b6b0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:27.617807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-8418f7c3-16ad-488b-99e5-dfe9495116e7 req-aee51114-472d-4f87-9ac6-1d3bd5d1b6b0 service nova] Creating event network-vif-deleted:944c1aac-d4ef-42f2-9807-2800ed34d6b9 for instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 on hv-cinder-84684 Jul 02 03:40:27.622639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-8418f7c3-16ad-488b-99e5-dfe9495116e7 req-aee51114-472d-4f87-9ac6-1d3bd5d1b6b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090359 Jul 02 03:40:27.623266 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 314/617] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:40:27.745018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:27.745610 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:27.752603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:27.753069 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:27.753814 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:27.754251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:27.888881 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:27.897770 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-14cfa34c-fece-42f1-873b-32774e2928c2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1723 microversion: 2.1 time: 0.156803 Jul 02 03:40:27.898346 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 304/618] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:27 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:27.993614 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:27.994304 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:28.001044 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:28.001494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:28.002252 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:28.002739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:28.139538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:28.147533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7e362011-0095-49fd-a518-e630acc1d8c4 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.159870 Jul 02 03:40:28.148103 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 315/619] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:27 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:28.568630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:28.569237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:28.575747 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:28.576194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:28.576950 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:28.577384 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:28.608363 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:28.608798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:28.609236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lazy-loading 'fault' on Instance uuid 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:40:28.610966 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:28.663148 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:28.671194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f645ffcb-2a19-415e-b947-b5d8a4e63ebc tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1309 microversion: 2.1 time: 0.106449 Jul 02 03:40:28.671807 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 305/620] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:28 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:28.917716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:28.918286 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:28.925524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:28.926021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:28.926852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:28.927345 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:29.064025 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:29.072244 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0369d311-f1b5-4830-bd60-491140192fb4 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1723 microversion: 2.1 time: 0.159629 Jul 02 03:40:29.072809 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 316/621] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:28 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:29.164940 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:29.165549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:29.172838 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:29.173225 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:29.173988 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:29.174421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:29.315789 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:29.323330 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-297691bc-1e87-4b59-b271-0040d62edade tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.162378 Jul 02 03:40:29.324201 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 306/622] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:29 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:29.693290 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:29.694274 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:29.701761 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:29.702260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:29.703136 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:29.703678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:29.738990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:29.739477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:29.740033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lazy-loading 'fault' on Instance uuid 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:40:29.787716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:29.798661 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8e9fb0be-a5af-4831-a392-78f68e1ba1f5 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1309 microversion: 2.1 time: 0.111607 Jul 02 03:40:29.799516 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 317/623] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:29 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:30.097596 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:30.098524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:30.108025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:30.108675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:30.109780 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:30.110411 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:30.248385 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:30.256752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0bde22ee-f39f-4ff3-84cb-e32233b675f6 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1723 microversion: 2.1 time: 0.164801 Jul 02 03:40:30.257319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 307/624] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:30 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:30.340007 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:30.340594 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:30.347432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:30.347949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:30.348647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:30.349081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:30.482048 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:30.489792 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4a0b441e-f049-418c-99b4-c42d565ca3ae tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.153694 Jul 02 03:40:30.490525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 318/625] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:30 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:30.819851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:30.820844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:30.830898 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:30.831718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:30.832965 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:30.833804 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:30.864778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:30.865302 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:30.865747 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lazy-loading 'fault' on Instance uuid 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:40:30.912889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6346c2aa3ab4ebabd9bbd0b9c441ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eba05f9e3a8402f96924c5c715229a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:30.921139 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b8edce73-88f8-4559-81d6-2da9b92a9028 tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 200 len: 1309 microversion: 2.1 time: 0.107801 Jul 02 03:40:30.921789 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 308/626] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:30 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:31.274440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:31.275195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:31.281377 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.281832 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.282668 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.283096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.412228 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:31.421022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e6751683-6606-4b0b-b871-90d8e4ef19bc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1729 microversion: 2.1 time: 0.150701 Jul 02 03:40:31.421586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 319/627] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:31 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:31.438007 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4c1e4673-7149-4137-bc18-00320364a3b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:31.438569 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4c1e4673-7149-4137-bc18-00320364a3b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:31.446467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c1e4673-7149-4137-bc18-00320364a3b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.447015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c1e4673-7149-4137-bc18-00320364a3b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.448265 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c1e4673-7149-4137-bc18-00320364a3b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.448702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c1e4673-7149-4137-bc18-00320364a3b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.507943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:31.508578 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:31.514570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.515369 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.516654 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.517010 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.528536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4c1e4673-7149-4137-bc18-00320364a3b0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094502 Jul 02 03:40:31.529681 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 309/628] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:40:31 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:40:31.751854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:31.760339 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6b8c3a32-e671-47a9-982f-5e3b391da776 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.256713 Jul 02 03:40:31.760913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 320/629] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:31 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:40:31.938160 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:31.938766 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] [instance: 3f0513dd-d098-4c32-a5fd-4e2f036dfe99] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:31.945210 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.945659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.946427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:31.946865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:31.960432 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] HTTP exception thrown: Instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 could not be found. Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Request method failure captured: Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 HTTP/1.1 Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv72GEtepMdNfLmrbuviXb_FkkXZ0P0RwS0qLh8NWGRcD0PuT4khLgyDx_pOpH466JfAlIeY8vMR52V2dFqUx5q2O5f-YjgP7drZOGIGYa1XfoaobRAXAu0_qsb57mH7f0u-kQVh05loXR-L0XWRYjXHCDjyhN_7rZD70lP1TdAtrL2A Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 8eba05f9e3a8402f96924c5c715229a5 Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesSnapshotTestJSON-164239314 Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:40:31.961961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8eba05f9e3a8402f96924c5c715229a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8eba05f9e3a8402f96924c5c715229a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8eba05f9e3a8402f96924c5c715229a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8eba05f9e3a8402f96924c5c715229a5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesSnapshotTestJSON-164239314 Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 8eba05f9e3a8402f96924c5c715229a5 Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-164239314 Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesSnapshotTestJSON-164239314-project Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: a6346c2aa3ab4ebabd9bbd0b9c441ad3 Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesSnapshotTestJSON-164239314-project Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 could not be found. Jul 02 03:40:31.963557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '3f0513dd-d098-4c32-a5fd-4e2f036dfe99'} Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 could not be found. Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:40:31.964798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 could not be found. Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 could not be found. Jul 02 03:40:31.966228 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:40:31.967457 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] Returning 404 to user: Instance 3f0513dd-d098-4c32-a5fd-4e2f036dfe99 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:40:31.967457 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ac3bf9a4-24ea-497c-8560-4a6e944fd6ec tempest-VolumesSnapshotTestJSON-164239314 tempest-VolumesSnapshotTestJSON-164239314-project] 10.222.0.42 "GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99" status: 404 len: 111 microversion: 2.1 time: 0.029127 Jul 02 03:40:31.967457 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 310/630] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:31 2022] GET /compute/v2.1/servers/3f0513dd-d098-4c32-a5fd-4e2f036dfe99 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:40:32.748179 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-8b665e5c-73a9-453e-b69e-2c9706c1c15e req-0ff72e5a-f790-4ebd-befb-76a921d6f7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee", "tag": "93c7269e-7d3c-40f8-8470-e61f2bab54ea"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:40:32.756551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-8b665e5c-73a9-453e-b69e-2c9706c1c15e req-0ff72e5a-f790-4ebd-befb-76a921d6f7e5 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:32.756996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-8b665e5c-73a9-453e-b69e-2c9706c1c15e req-0ff72e5a-f790-4ebd-befb-76a921d6f7e5 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:32.768248 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-8b665e5c-73a9-453e-b69e-2c9706c1c15e req-0ff72e5a-f790-4ebd-befb-76a921d6f7e5 service nova] Creating event network-changed:93c7269e-7d3c-40f8-8470-e61f2bab54ea for instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee on hv-cinder-84684 Jul 02 03:40:32.774857 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-8b665e5c-73a9-453e-b69e-2c9706c1c15e req-0ff72e5a-f790-4ebd-befb-76a921d6f7e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093475 Jul 02 03:40:32.775484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 321/631] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:40:32.880691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:32.881538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:32.887677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:32.888124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:32.888882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:32.889311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:33.032871 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:33.040499 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6bbb0ca0-14a1-4a3f-bab5-14c1b9d28bd2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.265493 Jul 02 03:40:33.041057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 311/632] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:32 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:34.065021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:34.066119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:34.073683 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:34.074133 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:34.074894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:34.075325 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:34.214475 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:34.225173 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f5f0b71e-778b-43fa-908d-47844fd81365 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.168451 Jul 02 03:40:34.225732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 322/633] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:34 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:34.793152 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-35a3d678-1b33-4d77-9266-d01b1e6c3367 req-9d819ba9-aeca-4de4-b234-118e67fe0ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee", "tag": "93c7269e-7d3c-40f8-8470-e61f2bab54ea"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:40:34.802177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-35a3d678-1b33-4d77-9266-d01b1e6c3367 req-9d819ba9-aeca-4de4-b234-118e67fe0ff0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:34.802690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-35a3d678-1b33-4d77-9266-d01b1e6c3367 req-9d819ba9-aeca-4de4-b234-118e67fe0ff0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:34.813721 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-35a3d678-1b33-4d77-9266-d01b1e6c3367 req-9d819ba9-aeca-4de4-b234-118e67fe0ff0 service nova] Creating event network-changed:93c7269e-7d3c-40f8-8470-e61f2bab54ea for instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee on hv-cinder-84684 Jul 02 03:40:34.818786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-35a3d678-1b33-4d77-9266-d01b1e6c3367 req-9d819ba9-aeca-4de4-b234-118e67fe0ff0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029629 Jul 02 03:40:34.819514 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 312/634] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:40:35.246978 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:35.247929 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:35.259096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:35.259888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:35.261136 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:35.261854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:35.403588 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:35.411241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-875178ff-2282-4bd9-b32d-3be08f0c3e56 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.171178 Jul 02 03:40:35.411832 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 323/635] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:35 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:36.435953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:36.437468 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:36.442897 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=64 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:36.452702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:36.453489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:36.454575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:36.455326 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:36.595864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:36.603830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d9abe354-5ce7-4b3b-b8a2-9df16c58c6aa tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.177410 Jul 02 03:40:36.604384 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 313/636] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:36 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:37.623109 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:37.623766 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:37.631209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:37.631976 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:37.636538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:37.636538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:37.785300 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:37.794915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5400254d-fb41-4e4d-88df-29a3e39a5479 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.177345 Jul 02 03:40:37.795460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 324/637] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:37 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:38.063105 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-b04f3b49-b0ae-46bb-ad42-ba9820ddc6f6 req-2c97ede5-2e93-4575-ace5-453e3fe3e745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c09baf3-acd2-45b3-bce4-9fd6b31efdac", "name": "network-vif-unplugged", "status": "completed", "tag": "e19a69f0-6e0d-4a86-85f9-02d1861bdf96"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:40:38.072442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-b04f3b49-b0ae-46bb-ad42-ba9820ddc6f6 req-2c97ede5-2e93-4575-ace5-453e3fe3e745 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:38.073335 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-b04f3b49-b0ae-46bb-ad42-ba9820ddc6f6 req-2c97ede5-2e93-4575-ace5-453e3fe3e745 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:38.089001 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-b04f3b49-b0ae-46bb-ad42-ba9820ddc6f6 req-2c97ede5-2e93-4575-ace5-453e3fe3e745 service nova] Creating event network-vif-unplugged:e19a69f0-6e0d-4a86-85f9-02d1861bdf96 for instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac on hv-cinder-84684 Jul 02 03:40:38.094798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-b04f3b49-b0ae-46bb-ad42-ba9820ddc6f6 req-2c97ede5-2e93-4575-ace5-453e3fe3e745 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116385 Jul 02 03:40:38.095461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 314/638] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:40:38.812223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:38.812822 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:38.820107 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:38.820553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:38.821318 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:38.821846 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:38.836936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:38.957974 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:38.968322 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1b2c5ff1-1bc0-423a-9019-3c6f1efa3158 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1509 microversion: 2.1 time: 0.159899 Jul 02 03:40:38.969448 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 325/639] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:38 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:38.985927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-09b3069c-c162-49a6-9997-4275d4f98aa1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:40:38.986648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-09b3069c-c162-49a6-9997-4275d4f98aa1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:38.993516 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09b3069c-c162-49a6-9997-4275d4f98aa1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:38.993960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09b3069c-c162-49a6-9997-4275d4f98aa1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:38.994726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09b3069c-c162-49a6-9997-4275d4f98aa1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:38.995154 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09b3069c-c162-49a6-9997-4275d4f98aa1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:39.137868 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-09b3069c-c162-49a6-9997-4275d4f98aa1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "POST /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac/action" status: 202 len: 0 microversion: 2.1 time: 0.156188 Jul 02 03:40:39.138548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 315/640] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:40:38 2022] POST /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:40:39.147726 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:39.148383 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:39.154547 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:39.154987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:39.155884 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:39.156322 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:39.306631 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:39.314490 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-671f5ec2-044c-4e82-8c6f-b2f1719bb448 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1517 microversion: 2.1 time: 0.171350 Jul 02 03:40:39.315922 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 326/641] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:39 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:40.333211 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:40.333767 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:40.340983 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:40.341436 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:40.342251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:40.342684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:40.481431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:40.489954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-57dd0673-8598-4546-b278-bff16126a2a2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1519 microversion: 2.1 time: 0.160832 Jul 02 03:40:40.490588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 316/642] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:40 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:41.509602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:41.510316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:41.517694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:41.518480 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:41.519542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:41.520049 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:41.657212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:41.665066 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1470e151-296c-413f-8892-9836e988b505 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.159860 Jul 02 03:40:41.665567 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 327/643] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:41 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:42.682697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:42.683320 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:42.689993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:42.690625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:42.691409 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:42.691839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:42.835428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:42.843390 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fa247ccd-6168-4bbe-b74f-79531e3818eb tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.164645 Jul 02 03:40:42.843949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 317/644] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:42 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:43.860471 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:43.861039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:43.868150 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:43.868617 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:43.869378 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:43.869817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:44.010936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:44.018731 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-987f8982-85ad-414c-b623-f564f8ececf3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.162228 Jul 02 03:40:44.019329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 328/645] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:43 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:45.036427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:45.037012 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:45.045049 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:45.045562 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:45.046257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:45.046687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:45.192462 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:45.201351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ee5101e7-74f0-47bd-98c0-d67328af2fca tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.168901 Jul 02 03:40:45.201924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 318/646] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:45 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:46.219092 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:46.219917 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:46.227891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:46.228415 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:46.229293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:46.229768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:46.368059 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:46.376692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-91d1be67-aa14-40a9-86a4-404ab8c63865 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.161862 Jul 02 03:40:46.379349 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 329/647] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:46 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:47.398531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:47.399730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:47.411116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:47.411918 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:47.413183 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:47.413909 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:47.558300 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:47.565923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5c5073d8-c029-46f2-87de-ec65314276f0 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.174007 Jul 02 03:40:47.566500 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 319/648] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:47 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:48.583718 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:48.584332 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:48.590884 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:48.591322 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:48.592098 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:48.592525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:48.733188 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:48.745363 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1e7e40c6-5413-46fe-b56c-471da60369c8 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.165422 Jul 02 03:40:48.746153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 330/649] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:48 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:49.766288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:49.767285 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:49.776915 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:49.777363 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:49.778129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:49.778560 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:49.920761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:49.928283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-504ffc59-929a-4f11-adc2-7cabc9d316fc tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.168788 Jul 02 03:40:49.928844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 320/650] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:49 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:50.948372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:50.948978 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:50.951500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:50.957691 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:50.958149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:50.958913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:50.959367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:51.104674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:51.113577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-12b9a5cd-9021-4b3a-ae23-2efaa8566446 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.170750 Jul 02 03:40:51.114148 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 331/651] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:50 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:52.132023 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:52.132770 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:52.140340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:52.140772 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:52.141560 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:52.141966 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:52.281712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:52.293671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-360c3c14-1ed0-4e71-baa4-9734d43d6137 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.165554 Jul 02 03:40:52.294461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 321/652] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:52 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:53.316839 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:53.317462 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:53.325059 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:53.325505 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:53.326269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:53.326699 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:53.470455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:53.478615 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3514b99b-2f70-46f9-a92d-c66f24507679 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.166076 Jul 02 03:40:53.479382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 332/653] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:53 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:54.500040 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:54.501096 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:54.512431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:54.513180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:54.514432 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:54.515158 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:54.653582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:54.665800 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-50076a83-0b0a-4187-9332-b61fe524a5ff tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.172019 Jul 02 03:40:54.667524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 322/654] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:54 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:55.688939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:55.689606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:55.697522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:55.698079 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:55.698851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:55.699440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:55.838772 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:55.846738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-21317057-3564-4d6d-9190-aeb92d6d786a tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.162117 Jul 02 03:40:55.847318 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 333/655] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:55 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:56.868493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:56.869680 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:56.880183 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:56.880935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:56.882197 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:56.882917 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:56.886568 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:57.030483 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:57.038165 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2973f8f1-54cb-47e4-bc67-c815bdf27d84 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.176308 Jul 02 03:40:57.038735 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 323/656] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:56 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:58.056638 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:58.057245 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:58.064679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:58.065084 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:58.065855 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:58.066316 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:58.204732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:58.213955 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0b8533bc-f6e3-4ee0-bec3-c99242f046e2 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.161312 Jul 02 03:40:58.214521 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 334/657] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:58 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:40:59.230903 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:40:59.231596 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:40:59.238364 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:59.238812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:59.239599 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:40:59.240030 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:40:59.382084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:40:59.390061 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d5cf27e5-d98a-48cc-9415-d7b383196c47 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.163328 Jul 02 03:40:59.390636 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 324/658] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:40:59 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:00.151218 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-e3a69267-77b6-40bf-817f-fcb3c318d780 req-1b4f2a86-1f7c-46c8-b92c-e5486e03400c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c09baf3-acd2-45b3-bce4-9fd6b31efdac", "name": "network-vif-plugged", "status": "completed", "tag": "e19a69f0-6e0d-4a86-85f9-02d1861bdf96"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:00.160579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-e3a69267-77b6-40bf-817f-fcb3c318d780 req-1b4f2a86-1f7c-46c8-b92c-e5486e03400c service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:00.161008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-e3a69267-77b6-40bf-817f-fcb3c318d780 req-1b4f2a86-1f7c-46c8-b92c-e5486e03400c service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:00.173279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-e3a69267-77b6-40bf-817f-fcb3c318d780 req-1b4f2a86-1f7c-46c8-b92c-e5486e03400c service nova] Creating event network-vif-plugged:e19a69f0-6e0d-4a86-85f9-02d1861bdf96 for instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac on hv-cinder-84684 Jul 02 03:41:00.178486 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-e3a69267-77b6-40bf-817f-fcb3c318d780 req-1b4f2a86-1f7c-46c8-b92c-e5486e03400c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Jul 02 03:41:00.179090 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 335/659] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:00.408062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:00.408665 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:00.420509 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:00.421101 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:00.422093 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:00.422564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:00.573022 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:00.581478 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0838083e-382c-4262-8b7f-a718b14794de tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.177473 Jul 02 03:41:00.582044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 325/660] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:00 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:01.605236 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:01.605924 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:01.612768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:01.613216 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:01.613981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:01.614399 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:01.767040 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:01.776793 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-84851592-4c9e-4500-9e82-76fbbdc70566 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1575 microversion: 2.1 time: 0.178063 Jul 02 03:41:01.777470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 336/661] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:01 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:02.797511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:02.798126 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:02.805182 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:02.805677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:02.806511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:02.806991 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:02.943231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:02.951186 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c35fe381-6cc9-48bf-8b9e-83d41003ff9c tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1562 microversion: 2.1 time: 0.159595 Jul 02 03:41:02.951757 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 326/662] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:02 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:05.454395 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ec971137-73e7-4e7b-94f3-25f873a81d06 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:05.454960 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ec971137-73e7-4e7b-94f3-25f873a81d06 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:05.460962 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec971137-73e7-4e7b-94f3-25f873a81d06 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.461403 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec971137-73e7-4e7b-94f3-25f873a81d06 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.462157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec971137-73e7-4e7b-94f3-25f873a81d06 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.462587 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ec971137-73e7-4e7b-94f3-25f873a81d06 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.485612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ec971137-73e7-4e7b-94f3-25f873a81d06 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028/ips" status: 200 len: 151 microversion: 2.1 time: 0.281953 Jul 02 03:41:05.486161 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 337/663] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:41:05 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028/ips => generated 151 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:05.499973 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78fffb3e-e29d-4700-b4ac-875f811d95d2"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:05.501097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:05.507984 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.508432 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.509200 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.509632 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.590525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Invalid volume: volume 78fffb3e-e29d-4700-b4ac-875f811d95d2 is already attached to instances: e880e075-40f8-4727-b142-83ae3e2c6d03 Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: POST /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028/os-volume_attachments HTTP/1.1 Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 74 Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:41:05.592278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {"volumeAttachment": {"volumeId": "78fffb3e-e29d-4700-b4ac-875f811d95d2"}} Jul 02 03:41:05.593817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Invalid volume: volume 78fffb3e-e29d-4700-b4ac-875f811d95d2 is already attached to instances: e880e075-40f8-4727-b142-83ae3e2c6d03 Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'server_id': '671321a8-96a7-4fc0-96b1-0fd9b12dc028', 'body': {'volumeAttachment': {'volumeId': '78fffb3e-e29d-4700-b4ac-875f811d95d2'}}} Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 78fffb3e-e29d-4700-b4ac-875f811d95d2 is already attached to instances: e880e075-40f8-4727-b142-83ae3e2c6d03 Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:05.595025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 78fffb3e-e29d-4700-b4ac-875f811d95d2 is already attached to instances: e880e075-40f8-4727-b142-83ae3e2c6d03 Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:05.596964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 78fffb3e-e29d-4700-b4ac-875f811d95d2 is already attached to instances: e880e075-40f8-4727-b142-83ae3e2c6d03 Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 400 to user: Invalid volume: volume 78fffb3e-e29d-4700-b4ac-875f811d95d2 is already attached to instances: e880e075-40f8-4727-b142-83ae3e2c6d03 {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1caaf955-6b04-4b76-8d41-e21805f2e127 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098286 Jul 02 03:41:05.599035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 327/664] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:41:05 2022] POST /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:41:05.603417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:05.603913 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:05.610681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.611131 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.611929 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.612361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.637208 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:41:05.719227 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5a710089-5105-47cd-ae8d-fff11a987edf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 204 len: 0 microversion: 2.1 time: 0.119602 Jul 02 03:41:05.719896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 338/665] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:41:05 2022] DELETE /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:41:05.728470 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:05.729088 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:05.736221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.736670 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.737436 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:05.737875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:05.867153 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:05.879120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-82ae51c4-202d-4012-ab9f-2e96f9831605 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1680 microversion: 2.1 time: 0.154377 Jul 02 03:41:05.879936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 328/666] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:05 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:41:06.904045 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:06.904683 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:06.912297 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:06.912791 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:06.913626 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:06.914094 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:07.058674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:07.066397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3568dab6-5125-49b7-9785-ff7d808061e2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1680 microversion: 2.1 time: 0.169261 Jul 02 03:41:07.066961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 339/667] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:06 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:08.085044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:08.085632 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:08.087956 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=34 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:08.094642 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:08.095092 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:08.095934 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:08.096372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:08.230884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:08.239131 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-11e00d38-43f2-4f7d-ba20-1471bf369b22 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 200 len: 1680 microversion: 2.1 time: 0.157970 Jul 02 03:41:08.240067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 329/668] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:08 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:41:08.629518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-ade8266b-d8c2-4ace-89f7-9d8f65cfadc9 req-79410946-e874-483b-964f-17aa2fde3f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671321a8-96a7-4fc0-96b1-0fd9b12dc028", "name": "network-vif-deleted", "tag": "bb25a94a-0fca-42e7-a4a5-8f6b9068b426"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:08.638162 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-ade8266b-d8c2-4ace-89f7-9d8f65cfadc9 req-79410946-e874-483b-964f-17aa2fde3f08 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:08.638971 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-ade8266b-d8c2-4ace-89f7-9d8f65cfadc9 req-79410946-e874-483b-964f-17aa2fde3f08 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:08.651072 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-ade8266b-d8c2-4ace-89f7-9d8f65cfadc9 req-79410946-e874-483b-964f-17aa2fde3f08 service nova] Creating event network-vif-deleted:bb25a94a-0fca-42e7-a4a5-8f6b9068b426 for instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 on hv-cinder-84684 Jul 02 03:41:08.656098 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-ade8266b-d8c2-4ace-89f7-9d8f65cfadc9 req-79410946-e874-483b-964f-17aa2fde3f08 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030135 Jul 02 03:41:08.657180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 340/669] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:08.715768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:41:08.716146 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 03:41:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:41:09.258646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:09.260682 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:09.269587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:09.270576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:09.271843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:09.272534 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:09.300877 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 HTTP/1.1 Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:41:09.303028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:41:09.304752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '671321a8-96a7-4fc0-96b1-0fd9b12dc028'} Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:41:09.305603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:41:09.306993 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:09.316416 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:41:09.317365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-da5c31d1-6055-4258-a556-9d6f0f583f4a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 404 len: 111 microversion: 2.1 time: 0.063662 Jul 02 03:41:09.318313 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 330/670] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:09 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:41:09.327138 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-55d26e8a-d0f9-4a82-aaa9-1c6d88e7f200 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '.version_select at 0x7f2e9776a4c0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:09.359551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-55d26e8a-d0f9-4a82-aaa9-1c6d88e7f200 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-65762965" status: 202 len: 0 microversion: 2.1 time: 0.036711 Jul 02 03:41:09.360214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 341/671] 10.222.0.42 () {58 vars in 1214 bytes} [Sat Jul 2 03:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-65762965 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:41:10.105735 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:10.106449 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:10.113121 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:10.113575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:10.114360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:10.114811 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:10.198186 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lazy-loading 'services' on Instance uuid e880e075-40f8-4727-b142-83ae3e2c6d03 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:41:10.278440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e9bfcfb9-cc9c-48d7-9563-0c4e242b5ece tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments/78fffb3e-e29d-4700-b4ac-875f811d95d2" status: 202 len: 0 microversion: 2.1 time: 0.177090 Jul 02 03:41:10.280007 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 331/672] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:41:10 2022] DELETE /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments/78fffb3e-e29d-4700-b4ac-875f811d95d2 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:41:10.287910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-31d9f1c6-3738-4d16-9743-17e235dbc6bd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:10.289942 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-31d9f1c6-3738-4d16-9743-17e235dbc6bd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:10.298157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31d9f1c6-3738-4d16-9743-17e235dbc6bd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:10.298616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31d9f1c6-3738-4d16-9743-17e235dbc6bd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:10.299437 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31d9f1c6-3738-4d16-9743-17e235dbc6bd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:10.299894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-31d9f1c6-3738-4d16-9743-17e235dbc6bd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:10.302475 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:10.332279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-31d9f1c6-3738-4d16-9743-17e235dbc6bd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048537 Jul 02 03:41:10.332926 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 342/673] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:41:10 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:11.345694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fba14848-d0da-4109-a624-b474d2ee6fbf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:11.346771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fba14848-d0da-4109-a624-b474d2ee6fbf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:11.353645 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fba14848-d0da-4109-a624-b474d2ee6fbf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:11.354108 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fba14848-d0da-4109-a624-b474d2ee6fbf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:11.354860 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fba14848-d0da-4109-a624-b474d2ee6fbf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:11.355286 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fba14848-d0da-4109-a624-b474d2ee6fbf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:11.390851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fba14848-d0da-4109-a624-b474d2ee6fbf tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049680 Jul 02 03:41:11.391329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 332/674] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:41:11 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:41:11.455185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:11.455768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:11.465990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:11.466436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:11.467198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:11.467665 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:11.494360 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:41:11.584102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b911597b-333e-4e10-bb06-8c7bf2b19886 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 204 len: 0 microversion: 2.1 time: 0.134403 Jul 02 03:41:11.584666 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 343/675] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:41:11 2022] DELETE /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:41:11.593365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:11.593970 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:11.600270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:11.600718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:11.601467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:11.601898 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:11.743353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:11.752240 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-77da6959-6aed-4e3d-b7c7-76fee95a8397 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1681 microversion: 2.1 time: 0.162831 Jul 02 03:41:11.752802 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 333/676] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:11 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:12.774578 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:12.775779 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:12.788096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:12.788729 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:12.790041 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:12.790742 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:12.923141 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:12.930860 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2d9cc9e4-7b34-45d7-91e0-31800b215df2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1681 microversion: 2.1 time: 0.163383 Jul 02 03:41:12.931786 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 344/677] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:12 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:13.846293 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-1459c3fe-75e5-49bb-9b45-8e42687d92d5 req-8e985f09-1968-4664-9e16-60195d7f353a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e880e075-40f8-4727-b142-83ae3e2c6d03", "name": "network-vif-deleted", "tag": "54a638db-254c-4005-b3f3-014e45f9ff9e"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:13.854872 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-1459c3fe-75e5-49bb-9b45-8e42687d92d5 req-8e985f09-1968-4664-9e16-60195d7f353a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:13.855336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-1459c3fe-75e5-49bb-9b45-8e42687d92d5 req-8e985f09-1968-4664-9e16-60195d7f353a service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:13.867488 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-1459c3fe-75e5-49bb-9b45-8e42687d92d5 req-8e985f09-1968-4664-9e16-60195d7f353a service nova] Creating event network-vif-deleted:54a638db-254c-4005-b3f3-014e45f9ff9e for instance e880e075-40f8-4727-b142-83ae3e2c6d03 on hv-cinder-84684 Jul 02 03:41:13.873084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-1459c3fe-75e5-49bb-9b45-8e42687d92d5 req-8e985f09-1968-4664-9e16-60195d7f353a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031569 Jul 02 03:41:13.874227 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 334/678] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:13.948037 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:13.948789 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:13.955611 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:13.956215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:13.957412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:13.958005 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:13.994041 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:13.994583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:13.995113 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lazy-loading 'fault' on Instance uuid e880e075-40f8-4727-b142-83ae3e2c6d03 {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:41:14.044918 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:14.052954 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-28ea1141-553c-4445-8322-c38bc09892cd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 200 len: 1331 microversion: 2.1 time: 0.108909 Jul 02 03:41:14.053523 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 345/679] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:13 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:15.082976 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:15.084210 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:15.095266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:15.096140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:15.097461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:15.098190 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:15.115025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 HTTP/1.1 Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:41:15.116697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:41:15.118319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'e880e075-40f8-4727-b142-83ae3e2c6d03'} Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:41:15.119242 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:41:15.120798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:15.122679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:41:15.122679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ecce4ca0-9e22-46f7-810d-d7cfbe8541f2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 404 len: 111 microversion: 2.1 time: 0.043110 Jul 02 03:41:15.122679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 335/680] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:15 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:41:15.127188 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6f2101bd-097d-47ae-9d71-08f92731f540 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '.version_select at 0x7f2e9c0171f0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:15.148888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6f2101bd-097d-47ae-9d71-08f92731f540 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360202105" status: 202 len: 0 microversion: 2.1 time: 0.025370 Jul 02 03:41:15.149361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 346/681] 10.222.0.42 () {58 vars in 1217 bytes} [Sat Jul 2 03:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360202105 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:41:15.804139 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2976539f-42e6-4ec5-a83d-102f5cb39a47 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: .version_select at 0x7f2e97622ca0>, body: {"keypair": {"name": "tempest-keypair-383159877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEVxcLEkrmL5LgSsCZd4Oh9myekqAO9dSO7up4F1fc6+T4eI1dVd6DiOwDSOZ9feAumxU6lExIU8PwRrXmaLEVJMOKLXJkyppXYWG26yBJ0PL6a6qVWwFRk2XkEodXjZg=="}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:15.819109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-2976539f-42e6-4ec5-a83d-102f5cb39a47 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:41:15.823403 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-2976539f-42e6-4ec5-a83d-102f5cb39a47 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:41:15.854183 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2976539f-42e6-4ec5-a83d-102f5cb39a47 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053969 Jul 02 03:41:15.854775 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 336/682] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:41:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:17.135795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2090974441", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "389311ee-b4f4-4d7f-89a6-51f9bda5ef70"}], "security_groups": [{"name": "tempest-securitygroup--1552664044"}], "key_name": "tempest-keypair-383159877", "user_data": "}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:17.245675 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] validate_networks() for [('389311ee-b4f4-4d7f-89a6-51f9bda5ef70', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:41:17.725295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:41:17.725724 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:41:17.726259 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:41:17.726699 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:41:17.727117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:41:17.737180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:17.737632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:17.738436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:17.738883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:17.756426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:41:17.760789 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:41:17.774441 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:41:17.777847 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:41:17.834094 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-77768a55-1973-4271-9cea-214761c2a9a4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.702762 Jul 02 03:41:17.834727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 347/683] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:41:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:41:17.845006 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4453f0f9-2c48-4ba3-b29e-178ce36da0c3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:17.846435 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4453f0f9-2c48-4ba3-b29e-178ce36da0c3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:17.906576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-4453f0f9-2c48-4ba3-b29e-178ce36da0c3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:17.913463 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4453f0f9-2c48-4ba3-b29e-178ce36da0c3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1241 microversion: 2.1 time: 0.072505 Jul 02 03:41:17.914036 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 337/684] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:17 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:18.931728 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:18.932966 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:18.940195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:18.940618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:18.941606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:18.942038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:19.016868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:19.024794 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-57b1b0d9-9bb6-4253-8c8c-1d24426afd43 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1301 microversion: 2.1 time: 0.097569 Jul 02 03:41:19.025411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 348/685] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:18 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:20.042524 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:20.043129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:20.050064 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:20.050515 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:20.051288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:20.051758 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:20.189887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:20.197947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b610a406-0aeb-4e60-8783-20aa08523f10 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.159551 Jul 02 03:41:20.198486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 338/686] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:20 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:20.466583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-a0635620-8f74-42ca-b2ab-22240886af46 req-68fb641b-65d7-47d9-aec0-c80a02077c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff687e9-ce72-49c7-bb72-f563c433f7af", "tag": "41dcd48a-9142-481f-8774-b99c864c98bb"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:20.477952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-a0635620-8f74-42ca-b2ab-22240886af46 req-68fb641b-65d7-47d9-aec0-c80a02077c91 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:20.478550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-a0635620-8f74-42ca-b2ab-22240886af46 req-68fb641b-65d7-47d9-aec0-c80a02077c91 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:20.494774 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-a0635620-8f74-42ca-b2ab-22240886af46 req-68fb641b-65d7-47d9-aec0-c80a02077c91 service nova] Creating event network-changed:41dcd48a-9142-481f-8774-b99c864c98bb for instance 6ff687e9-ce72-49c7-bb72-f563c433f7af on hv-cinder-84684 Jul 02 03:41:20.500466 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-a0635620-8f74-42ca-b2ab-22240886af46 req-68fb641b-65d7-47d9-aec0-c80a02077c91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037419 Jul 02 03:41:20.500990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 349/687] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:21.217960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:21.218729 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:21.226351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:21.226828 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:21.227793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:21.228094 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:21.362217 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:21.373360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-44ed98bf-427d-4ad9-84f8-c973e5d151fc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.160544 Jul 02 03:41:21.373865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 339/688] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:21 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:22.396186 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:22.397215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:22.401125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:22.411451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:22.412181 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:22.413451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:22.414165 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:22.559938 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:22.571801 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a2cd54ec-4ffd-46b3-a1a0-5160a60b064b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.183016 Jul 02 03:41:22.572641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 350/689] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:22 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:23.594713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:23.595445 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:23.602826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:23.603274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:23.604061 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:23.604489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:23.962458 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:23.970145 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-46ef34ef-c4a0-4e65-b845-dd211db6bcf2 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.379976 Jul 02 03:41:23.970712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 340/690] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:23 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:24.991596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:24.992727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:25.001782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.002232 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.002990 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.003461 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.155577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:25.163375 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c549010b-0128-4677-b287-b7861f1eab28 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.178520 Jul 02 03:41:25.163947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 351/691] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:24 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:25.280510 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d90be57c-9ed7-4c1e-a9ec-b47bf3619f51 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:25.281033 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d90be57c-9ed7-4c1e-a9ec-b47bf3619f51 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:25.287863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d90be57c-9ed7-4c1e-a9ec-b47bf3619f51 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.288310 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d90be57c-9ed7-4c1e-a9ec-b47bf3619f51 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.289073 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d90be57c-9ed7-4c1e-a9ec-b47bf3619f51 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.289503 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d90be57c-9ed7-4c1e-a9ec-b47bf3619f51 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.320482 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d90be57c-9ed7-4c1e-a9ec-b47bf3619f51 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments/41b9f6b7-c9d3-40ae-9a4f-da48642a778f" status: 200 len: 194 microversion: 2.20 time: 0.043357 Jul 02 03:41:25.324648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 341/692] 10.222.0.42 () {60 vars in 1453 bytes} [Sat Jul 2 03:41:25 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments/41b9f6b7-c9d3-40ae-9a4f-da48642a778f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:41:25.389770 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:25.390269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:25.396586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.397030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.397807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.398235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.529928 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lazy-loading 'services' on Instance uuid bd2d5a1f-4e5b-4072-851a-d01f23742f55 {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:41:25.642760 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-96920b9f-635f-45ab-9e4e-42915a20a44a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments/41b9f6b7-c9d3-40ae-9a4f-da48642a778f" status: 202 len: 0 microversion: 2.20 time: 0.257701 Jul 02 03:41:25.643408 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 352/693] 10.222.0.42 () {60 vars in 1456 bytes} [Sat Jul 2 03:41:25 2022] DELETE /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments/41b9f6b7-c9d3-40ae-9a4f-da48642a778f => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:41:25.651842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d360de20-074d-45fb-a0a3-71bf3fddc44f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:25.652791 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d360de20-074d-45fb-a0a3-71bf3fddc44f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:25.659452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d360de20-074d-45fb-a0a3-71bf3fddc44f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.659967 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d360de20-074d-45fb-a0a3-71bf3fddc44f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.660765 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d360de20-074d-45fb-a0a3-71bf3fddc44f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:25.661204 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d360de20-074d-45fb-a0a3-71bf3fddc44f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:25.692723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d360de20-074d-45fb-a0a3-71bf3fddc44f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044782 Jul 02 03:41:25.693268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 342/694] 10.222.0.42 () {60 vars in 1342 bytes} [Sat Jul 2 03:41:25 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 03:41:26.186463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:26.187465 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:26.197454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.198094 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:26.199241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.199920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:26.369339 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:26.379910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4ada731d-f96d-4186-b8a4-518db5657c3a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.198318 Jul 02 03:41:26.380743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 353/695] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:26 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:26.704841 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4677c973-a2da-4f78-8e84-27db2190fb00 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:26.705803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4677c973-a2da-4f78-8e84-27db2190fb00 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:26.712617 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4677c973-a2da-4f78-8e84-27db2190fb00 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.713071 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4677c973-a2da-4f78-8e84-27db2190fb00 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:26.713874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4677c973-a2da-4f78-8e84-27db2190fb00 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.714309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4677c973-a2da-4f78-8e84-27db2190fb00 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:26.716887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:26.746141 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4677c973-a2da-4f78-8e84-27db2190fb00 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045493 Jul 02 03:41:26.746753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 343/696] 10.222.0.42 () {60 vars in 1342 bytes} [Sat Jul 2 03:41:26 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:26.809453 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:26.809947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:26.816105 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.816543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:26.817292 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.817717 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:26.843088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:41:26.926548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4f0f31f4-9128-4cee-b2e8-91b8c59858b9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 204 len: 0 microversion: 2.20 time: 0.120753 Jul 02 03:41:26.927518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 354/697] 10.222.0.42 () {60 vars in 1279 bytes} [Sat Jul 2 03:41:26 2022] DELETE /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 03:41:26.936648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:26.937360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:26.943345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.943794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:26.944556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:26.945159 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:27.078633 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:27.086842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:27.088777 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:27.090180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dae28ccf-100b-435b-a09b-5be4807a822d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.157517 Jul 02 03:41:27.090845 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 344/698] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:26 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:27.397225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:27.397924 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:27.405208 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:27.405772 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:27.406603 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:27.407037 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:27.559339 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:27.567184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-757d5fe9-da22-4eb5-8e66-708c24282151 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.174356 Jul 02 03:41:27.567786 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 355/699] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:27 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:28.114605 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:28.117825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:28.120440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:28.130768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:28.131221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:28.132051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:28.132490 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:28.266491 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:28.276734 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:28.278182 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:28.279406 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-02a5b121-3962-41d6-acda-a40637ff6e48 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.172063 Jul 02 03:41:28.279980 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 345/700] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:28 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:28.293081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-a278460c-f65d-46a7-b37f-ae32ca6c422b req-1edf7326-433d-4030-b886-f6b69ffab6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff687e9-ce72-49c7-bb72-f563c433f7af", "name": "network-vif-plugged", "status": "completed", "tag": "41dcd48a-9142-481f-8774-b99c864c98bb"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:28.297888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:28.298507 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=6 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:28.302912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-a278460c-f65d-46a7-b37f-ae32ca6c422b req-1edf7326-433d-4030-b886-f6b69ffab6ed service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:28.303241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-a278460c-f65d-46a7-b37f-ae32ca6c422b req-1edf7326-433d-4030-b886-f6b69ffab6ed service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:28.315035 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-a278460c-f65d-46a7-b37f-ae32ca6c422b req-1edf7326-433d-4030-b886-f6b69ffab6ed service nova] Creating event network-vif-plugged:41dcd48a-9142-481f-8774-b99c864c98bb for instance 6ff687e9-ce72-49c7-bb72-f563c433f7af on hv-cinder-84684 Jul 02 03:41:28.319766 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-a278460c-f65d-46a7-b37f-ae32ca6c422b req-1edf7326-433d-4030-b886-f6b69ffab6ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030851 Jul 02 03:41:28.320542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 356/701] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:28.586578 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:28.587219 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:28.594847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:28.595317 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:28.596123 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:28.596550 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:28.727012 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:28.734980 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ded74d61-f761-46f4-8145-0a7dca44ed2f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.154019 Jul 02 03:41:28.735587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 346/702] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:28 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:29.304667 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:29.305963 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:29.315051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:29.315542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:29.316309 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:29.316744 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:29.331735 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:29.457824 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:29.466613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:29.468421 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:29.469465 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3bad536a-d819-4aec-be17-bcbfd28aca9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1724 microversion: 2.20 time: 0.172878 Jul 02 03:41:29.470044 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 357/703] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:29 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:29.756083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:29.757029 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:29.767120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:29.767605 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:29.768369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:29.768809 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:29.908867 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:29.916494 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-39a1366a-f177-4e81-9cac-afabad27aad8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1367 microversion: 2.1 time: 0.167161 Jul 02 03:41:29.917441 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 347/704] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:29 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:30.488808 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:30.489763 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:30.496775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:30.497229 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:30.498272 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:30.498891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:30.564409 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:30.572593 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:30.574073 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:30.575208 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5d71f88c-dba2-41e0-9a06-82eb025a8006 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 200 len: 1656 microversion: 2.20 time: 0.090574 Jul 02 03:41:30.575810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 358/705] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:30 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:30.704872 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-5247ee7c-3d55-4684-8a50-49caa9614ebb req-53e87b8a-dc73-4609-8a0c-5dc41db86116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2d5a1f-4e5b-4072-851a-d01f23742f55", "name": "network-vif-deleted", "tag": "01f88803-1998-4eea-820a-bbda30202ac5"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:30.713087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-5247ee7c-3d55-4684-8a50-49caa9614ebb req-53e87b8a-dc73-4609-8a0c-5dc41db86116 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:30.713529 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-5247ee7c-3d55-4684-8a50-49caa9614ebb req-53e87b8a-dc73-4609-8a0c-5dc41db86116 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:30.729111 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-5247ee7c-3d55-4684-8a50-49caa9614ebb req-53e87b8a-dc73-4609-8a0c-5dc41db86116 service nova] Creating event network-vif-deleted:01f88803-1998-4eea-820a-bbda30202ac5 for instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 on hv-cinder-84684 Jul 02 03:41:30.734448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-5247ee7c-3d55-4684-8a50-49caa9614ebb req-53e87b8a-dc73-4609-8a0c-5dc41db86116 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033085 Jul 02 03:41:30.734603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 348/706] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:30.934184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:30.936080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:30.942975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:30.943468 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:30.944275 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:30.944903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:31.084352 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:31.092180 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-df63b2d1-e0a9-42fb-a48a-44dec195e150 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1558 microversion: 2.1 time: 0.161976 Jul 02 03:41:31.092752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 359/707] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:30 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:31.112155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ee053de1-f1da-4500-9962-71113a2d233c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:31.112810 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ee053de1-f1da-4500-9962-71113a2d233c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:31.119086 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee053de1-f1da-4500-9962-71113a2d233c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:31.119627 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee053de1-f1da-4500-9962-71113a2d233c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:31.120516 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee053de1-f1da-4500-9962-71113a2d233c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:31.120965 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ee053de1-f1da-4500-9962-71113a2d233c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:31.198006 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ee053de1-f1da-4500-9962-71113a2d233c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093286 Jul 02 03:41:31.198602 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 349/708] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:41:31 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:31.594390 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:31.595121 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:31.605756 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:31.606223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:31.606996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:31.607455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:31.621384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] HTTP exception thrown: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Request method failure captured: Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 HTTP/1.1 Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zEyupuBKtztOeuitxYz5ELc7XeKAPMt1DVpam-2xKCvocm-vlbWmWttSZv2VCazCBDcOAglicsgin78b2IjLYoRijCMnvj5qKUN4JbsWG16AgiCxCV51qJwHxxoh5ibg3B6OYc1tX6V4S-sfDsq86_bkotMeHLHSao7UtTau2r-3M Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:41:31.623082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7f39e852f8d14dec8e98d8d77fe90766", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 112d731047a64efc8e9143c4d471a7d6 Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:41:31.624686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'bd2d5a1f-4e5b-4072-851a-d01f23742f55'} Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:41:31.625458 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:41:31.627198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:31.628295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Returning 404 to user: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:41:31.628295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fe43767f-cd8a-4632-8c8c-bbc8516b771a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 404 len: 111 microversion: 2.20 time: 0.034153 Jul 02 03:41:31.628864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 360/709] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:31 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 02 03:41:31.633663 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-79ac5748-4ca0-41c3-b2f0-df4f78f1edf9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '.version_select at 0x7f2e97572f70>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:31.655107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-79ac5748-4ca0-41c3-b2f0-df4f78f1edf9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-500178063" status: 204 len: 0 microversion: 2.20 time: 0.025172 Jul 02 03:41:31.659572 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 350/710] 10.222.0.42 () {60 vars in 1258 bytes} [Sat Jul 2 03:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-500178063 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 03:41:32.364850 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-bda536a6-372d-4e28-9421-1fde9308e5c1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'create', calling method: .version_select at 0x7f2e976d9ca0>, body: {"keypair": {"name": "tempest-keypair-234293212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOCXUoxs32NcrhuAqnC1c7rF5SnrT2M6o5XMVNaMKJDMlJA3u7cCsHDvoUYSNkqakkZdqA+LcFqEgxaCRHZZ8s4AOiniminxWZO1uVq7lc63VE9UunmwhANHQPKgE0nqg=="}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:32.379161 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-bda536a6-372d-4e28-9421-1fde9308e5c1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:41:32.383092 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-bda536a6-372d-4e28-9421-1fde9308e5c1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for user 112d731047a64efc8e9143c4d471a7d6 and project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:41:32.408185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-bda536a6-372d-4e28-9421-1fde9308e5c1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047080 Jul 02 03:41:32.408680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 361/711] 10.222.0.42 () {62 vars in 1199 bytes} [Sat Jul 2 03:41:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 03:41:32.753428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-f55e4161-45a7-4f45-8db5-4f7194c73154 req-4ef729e0-42bc-41d8-811b-90af1df5a7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff687e9-ce72-49c7-bb72-f563c433f7af", "tag": "41dcd48a-9142-481f-8774-b99c864c98bb"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:32.764887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-f55e4161-45a7-4f45-8db5-4f7194c73154 req-4ef729e0-42bc-41d8-811b-90af1df5a7e5 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:32.766237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-f55e4161-45a7-4f45-8db5-4f7194c73154 req-4ef729e0-42bc-41d8-811b-90af1df5a7e5 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:32.778243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-f55e4161-45a7-4f45-8db5-4f7194c73154 req-4ef729e0-42bc-41d8-811b-90af1df5a7e5 service nova] Creating event network-changed:41dcd48a-9142-481f-8774-b99c864c98bb for instance 6ff687e9-ce72-49c7-bb72-f563c433f7af on hv-cinder-84684 Jul 02 03:41:32.784226 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-f55e4161-45a7-4f45-8db5-4f7194c73154 req-4ef729e0-42bc-41d8-811b-90af1df5a7e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036391 Jul 02 03:41:32.785286 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 351/712] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:34.358903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-670373141", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc0b5a80-e232-44f7-a253-08cca2946b9f"}], "security_groups": [{"name": "tempest-securitygroup--429493286"}], "key_name": "tempest-keypair-234293212", "user_data": "}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:34.469574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] validate_networks() for [('dc0b5a80-e232-44f7-a253-08cca2946b9f', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:41:34.876015 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:41:34.876444 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:41:34.876916 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:41:34.877327 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:41:34.877732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:41:34.887010 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:34.887494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:34.888292 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:34.888724 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:34.905681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:41:34.909834 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Getting quotas for user 112d731047a64efc8e9143c4d471a7d6 and project 7f39e852f8d14dec8e98d8d77fe90766. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:41:34.921709 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:41:34.924004 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:41:34.971949 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1ebca7c4-7cbc-4167-bea8-97639b93e5b6 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.618052 Jul 02 03:41:34.972586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 362/713] 10.222.0.42 () {62 vars in 1187 bytes} [Sat Jul 2 03:41:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 03:41:34.984440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-34d30a50-7e6e-4cde-a901-f619825414b7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:34.985190 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-34d30a50-7e6e-4cde-a901-f619825414b7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:35.043248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-34d30a50-7e6e-4cde-a901-f619825414b7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:35.050936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-34d30a50-7e6e-4cde-a901-f619825414b7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:35.052688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-34d30a50-7e6e-4cde-a901-f619825414b7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:35.053783 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-34d30a50-7e6e-4cde-a901-f619825414b7 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1280 microversion: 2.20 time: 0.074708 Jul 02 03:41:35.054377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 352/714] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:34 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:36.073039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:36.073688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:36.081327 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:36.081778 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:36.082562 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:36.082967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:36.151919 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:36.160336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:36.162139 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:36.163452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c9a8417b-7a37-41cc-b692-982eb0646e8c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1350 microversion: 2.20 time: 0.094919 Jul 02 03:41:36.164153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 363/715] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:36 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:37.181664 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:37.182382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:37.190230 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:37.190786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:37.191676 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:37.192181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:37.323154 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:37.332699 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:37.334597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:37.336156 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-97f5cd82-cbbb-489c-afd2-b31c04947d7f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.158210 Jul 02 03:41:37.347113 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 353/716] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:37 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:37.593302 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-1da899d5-1bef-4d5a-a7a4-d677bbc1e4a5 req-5444f240-ea98-4c5d-8553-e2288c64fade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86c62ef-7db9-4c66-be31-20868e93d817", "tag": "41edcc3a-c954-4e67-a0a2-822da68709b0"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:37.605677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-1da899d5-1bef-4d5a-a7a4-d677bbc1e4a5 req-5444f240-ea98-4c5d-8553-e2288c64fade service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:37.606327 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-1da899d5-1bef-4d5a-a7a4-d677bbc1e4a5 req-5444f240-ea98-4c5d-8553-e2288c64fade service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:37.618783 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-1da899d5-1bef-4d5a-a7a4-d677bbc1e4a5 req-5444f240-ea98-4c5d-8553-e2288c64fade service nova] Creating event network-changed:41edcc3a-c954-4e67-a0a2-822da68709b0 for instance e86c62ef-7db9-4c66-be31-20868e93d817 on hv-cinder-84684 Jul 02 03:41:37.623845 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-1da899d5-1bef-4d5a-a7a4-d677bbc1e4a5 req-5444f240-ea98-4c5d-8553-e2288c64fade service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034154 Jul 02 03:41:37.624467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 364/717] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:38.360278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:38.361135 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:38.365460 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:38.376030 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:38.376483 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:38.377254 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:38.377685 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:38.516402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:38.529680 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:38.532052 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:38.533564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-eb94d73c-325a-43d7-8c6e-69a29383d666 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.181622 Jul 02 03:41:38.534128 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 354/718] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:38 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:39.224979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:39.225514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:39.233781 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:39.234243 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:39.235009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:39.235486 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:39.326412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lazy-loading 'services' on Instance uuid e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:41:39.405143 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e478af5d-9d31-4f30-bef9-abcf15284b9d tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments/b871a8c0-7322-4a0b-9708-d61c8f7d64f1" status: 202 len: 0 microversion: 2.1 time: 0.184970 Jul 02 03:41:39.405725 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 365/719] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:41:39 2022] DELETE /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments/b871a8c0-7322-4a0b-9708-d61c8f7d64f1 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:41:39.414498 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-89b8f046-c8f1-4270-b064-3824f5dc3d81 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:39.415542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-89b8f046-c8f1-4270-b064-3824f5dc3d81 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:39.422591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89b8f046-c8f1-4270-b064-3824f5dc3d81 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:39.423054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89b8f046-c8f1-4270-b064-3824f5dc3d81 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:39.423890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89b8f046-c8f1-4270-b064-3824f5dc3d81 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:39.424329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89b8f046-c8f1-4270-b064-3824f5dc3d81 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:39.453217 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-89b8f046-c8f1-4270-b064-3824f5dc3d81 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042734 Jul 02 03:41:39.453723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 355/720] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:41:39 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:39.557158 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:39.558315 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:39.569196 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:39.569977 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:39.571333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:39.572104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:39.720719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:39.732980 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:39.735283 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:39.736598 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cb0d143b-5f51-4915-ac1f-33a0bcafe373 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.186858 Jul 02 03:41:39.737195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 366/721] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:39 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:40.465237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6ad7f6bd-304e-400d-b640-9a6186956564 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:40.466178 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6ad7f6bd-304e-400d-b640-9a6186956564 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:40.472831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ad7f6bd-304e-400d-b640-9a6186956564 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:40.473280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ad7f6bd-304e-400d-b640-9a6186956564 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:40.474040 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ad7f6bd-304e-400d-b640-9a6186956564 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:40.474469 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ad7f6bd-304e-400d-b640-9a6186956564 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:40.504009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6ad7f6bd-304e-400d-b640-9a6186956564 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042750 Jul 02 03:41:40.504560 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 356/722] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:41:40 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:40.758717 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:40.759751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:40.770757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:40.771550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:40.772803 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:40.773561 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:40.925109 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:40.933742 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:40.935219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:40.936362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-aafb8086-1720-4e1d-bc40-c1c7ce512df2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.184124 Jul 02 03:41:40.936914 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 367/723] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:40 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:41.515613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-bf5c9f0f-cdb8-48be-9b7f-09171cee3eda tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:41.516568 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-bf5c9f0f-cdb8-48be-9b7f-09171cee3eda tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:41.523960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf5c9f0f-cdb8-48be-9b7f-09171cee3eda tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:41.524430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf5c9f0f-cdb8-48be-9b7f-09171cee3eda tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:41.525260 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf5c9f0f-cdb8-48be-9b7f-09171cee3eda tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:41.525697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bf5c9f0f-cdb8-48be-9b7f-09171cee3eda tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:41.558700 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-bf5c9f0f-cdb8-48be-9b7f-09171cee3eda tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Jul 02 03:41:41.559283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 357/724] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:41:41 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:41.960977 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:41.961574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:41.968760 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:41.969209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:41.969964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:41.970647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:42.122241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:42.130876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:42.132442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:42.133533 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a0d264c3-4710-4d7d-a6bb-0672deb4bdae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.176528 Jul 02 03:41:42.134095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 368/725] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:41 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:42.573814 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a2236bcd-31e6-4125-9a07-2c76f550b3cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:42.575450 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a2236bcd-31e6-4125-9a07-2c76f550b3cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:42.584172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a2236bcd-31e6-4125-9a07-2c76f550b3cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:42.584620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a2236bcd-31e6-4125-9a07-2c76f550b3cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:42.585379 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a2236bcd-31e6-4125-9a07-2c76f550b3cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:42.585778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a2236bcd-31e6-4125-9a07-2c76f550b3cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:42.618366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a2236bcd-31e6-4125-9a07-2c76f550b3cc tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050756 Jul 02 03:41:42.618927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 358/726] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:41:42 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:41:42.703464 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:42.704226 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:42.711144 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:42.711625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:42.712388 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:42.712815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:42.737132 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:41:42.817775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d04b0c98-d4e0-4982-990d-cc8e14dd9c01 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 204 len: 0 microversion: 2.1 time: 0.119239 Jul 02 03:41:42.818380 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 369/727] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:41:42 2022] DELETE /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:41:42.826428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:42.827046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:42.833622 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:42.834071 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:42.834836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:42.835269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:42.969095 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:42.977164 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ff0d9724-ade6-4a74-ad04-f907dbd426b9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1689 microversion: 2.1 time: 0.154486 Jul 02 03:41:42.977741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 359/728] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:42 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:43.152936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:43.153624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:43.160590 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:43.161042 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:43.161797 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:43.162231 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:43.308104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:43.316668 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:43.318174 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:43.319276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b11e1f47-e8a3-420f-97be-8d0d4f097629 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.170718 Jul 02 03:41:43.319871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 370/729] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:43 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:44.000044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:44.000984 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:44.012113 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:44.012863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:44.014151 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:44.014875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:44.161813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:44.169861 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-84052eee-eed0-44ff-9fd9-26312dc894a0 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1689 microversion: 2.1 time: 0.177270 Jul 02 03:41:44.170432 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 360/730] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:43 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:44.337735 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:44.338611 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:44.346687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:44.347265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:44.348403 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:44.348836 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:44.366329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-f97a68cf-71a2-4879-be3f-f4a70ac6f44c req-662a048e-7d38-4994-bd2d-97f59763b4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86c62ef-7db9-4c66-be31-20868e93d817", "name": "network-vif-plugged", "status": "completed", "tag": "41edcc3a-c954-4e67-a0a2-822da68709b0"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:44.375737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-f97a68cf-71a2-4879-be3f-f4a70ac6f44c req-662a048e-7d38-4994-bd2d-97f59763b4d3 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:44.376418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-f97a68cf-71a2-4879-be3f-f4a70ac6f44c req-662a048e-7d38-4994-bd2d-97f59763b4d3 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:44.388613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-f97a68cf-71a2-4879-be3f-f4a70ac6f44c req-662a048e-7d38-4994-bd2d-97f59763b4d3 service nova] Creating event network-vif-plugged:41edcc3a-c954-4e67-a0a2-822da68709b0 for instance e86c62ef-7db9-4c66-be31-20868e93d817 on hv-cinder-84684 Jul 02 03:41:44.393687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-f97a68cf-71a2-4879-be3f-f4a70ac6f44c req-662a048e-7d38-4994-bd2d-97f59763b4d3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Jul 02 03:41:44.394375 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 361/731] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:41:44.489463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:44.501832 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:44.504025 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:44.505054 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2ccb5e0a-27f5-41f2-b566-17250fac8c08 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.171352 Jul 02 03:41:44.505632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 371/732] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:44 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:45.185179 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:45.189658 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:45.190356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:45.197480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:45.197940 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:45.198706 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:45.199146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:45.334963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:45.342726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-42066136-97b4-4148-9a3d-60348f594746 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1689 microversion: 2.1 time: 0.159059 Jul 02 03:41:45.343222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 362/733] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:45 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:45.530815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:45.531663 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:45.534171 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:45.535019 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=10 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:45.544133 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:45.544723 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:45.545720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:45.546290 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:45.682998 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:45.691863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:45.693381 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:45.694519 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-aafddffb-5f4c-402f-85e6-99ecef045a03 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.168969 Jul 02 03:41:45.695078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 372/734] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:45 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:46.360180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:46.360767 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:46.368178 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:46.368571 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:46.369342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:46.370116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:46.512230 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:46.520170 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-028f4f8b-e3a5-4ef4-88d4-cf84ca47dfab tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1689 microversion: 2.1 time: 0.163543 Jul 02 03:41:46.523336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 363/735] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:46 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:46.721161 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:46.721711 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:46.729063 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:46.729522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:46.730290 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:46.730730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:46.872255 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:46.880677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:46.882172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:46.883278 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0c389025-ac08-4450-aeba-8d7799f1a6df tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.166258 Jul 02 03:41:46.883849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 373/736] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:46 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:47.537626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:47.538237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:47.545495 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:47.545959 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:47.547155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:47.547155 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:47.549771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:47.689459 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:47.697301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-03714644-1ac0-4fe2-a2f5-af0276356302 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1689 microversion: 2.1 time: 0.163697 Jul 02 03:41:47.698117 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 364/737] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:47 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:47.902514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:47.903111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:47.910775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:47.911329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:47.912291 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:47.912773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:48.046640 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:48.048924 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:48.055844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:48.057319 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:48.058428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-80c75521-7268-431c-8a75-e6e858623b52 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1405 microversion: 2.20 time: 0.161072 Jul 02 03:41:48.058988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 374/738] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:47 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:48.348431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-36d83bb8-315a-40cd-8ff7-d7b35c0b9e06 req-f79a251f-21e6-43de-b50d-6201da319e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee", "name": "network-vif-deleted", "tag": "93c7269e-7d3c-40f8-8470-e61f2bab54ea"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:48.363308 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-36d83bb8-315a-40cd-8ff7-d7b35c0b9e06 req-f79a251f-21e6-43de-b50d-6201da319e89 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:48.364114 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-36d83bb8-315a-40cd-8ff7-d7b35c0b9e06 req-f79a251f-21e6-43de-b50d-6201da319e89 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:48.377334 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-36d83bb8-315a-40cd-8ff7-d7b35c0b9e06 req-f79a251f-21e6-43de-b50d-6201da319e89 service nova] Creating event network-vif-deleted:93c7269e-7d3c-40f8-8470-e61f2bab54ea for instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee on hv-cinder-84684 Jul 02 03:41:48.384738 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-36d83bb8-315a-40cd-8ff7-d7b35c0b9e06 req-f79a251f-21e6-43de-b50d-6201da319e89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040868 Jul 02 03:41:48.386189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 365/739] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:48.714749 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:48.715364 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:48.723837 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:48.724288 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:48.725065 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:48.725500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:48.757761 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:48.758212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:48.758666 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lazy-loading 'fault' on Instance uuid e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:41:48.801438 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:48.810161 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5902cb24-46ed-4ff1-992d-b178d165f0d2 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 200 len: 1335 microversion: 2.1 time: 0.099674 Jul 02 03:41:48.810736 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 375/740] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:48 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:49.077032 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:49.077723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:49.084700 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:49.085149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:49.086175 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:49.086559 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:49.227515 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:49.235863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:49.237395 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:49.238569 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5c916486-94cc-4367-9315-7344db2eed65 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1597 microversion: 2.20 time: 0.166538 Jul 02 03:41:49.239138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 366/741] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:41:49 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:41:49.255918 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4a3a659c-7d9b-415a-9b3a-d8297e046dae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:49.256497 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4a3a659c-7d9b-415a-9b3a-d8297e046dae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:49.262795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a3a659c-7d9b-415a-9b3a-d8297e046dae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:49.263237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a3a659c-7d9b-415a-9b3a-d8297e046dae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:49.264025 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a3a659c-7d9b-415a-9b3a-d8297e046dae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:49.264462 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4a3a659c-7d9b-415a-9b3a-d8297e046dae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:49.346808 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4a3a659c-7d9b-415a-9b3a-d8297e046dae tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094726 Jul 02 03:41:49.347512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 376/742] 10.222.0.42 () {60 vars in 1315 bytes} [Sat Jul 2 03:41:49 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:41:49.830523 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:49.831358 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:49.838332 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:49.838786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:49.839594 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:49.840039 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:49.854105 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] HTTP exception thrown: Instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee could not be found. Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Request method failure captured: Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee HTTP/1.1 Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7y7bLzPUWFj-NGZjnUbomMq9pCCamrIuGlzdL46FEgS4ugkab4y2M6CbytxBUL8dkybAU6gDY9bUrXa1zy9U6WD5wxDq1C1uLmIU9sloFjK6V5E4AaTr6XlcaOHNRqXcACZxcYpwgyaccNXlLlp85hntILkHdL5-bxVYphqZoabe4w Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:41:49.855813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53c88ba2f03f47538ca0eaeb08ccfc07", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: c941dc00e0584666aba13263b8c1fcb8 Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee could not be found. Jul 02 03:41:49.857528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee'} Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee could not be found. Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:41:49.858546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee could not be found. Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee could not be found. Jul 02 03:41:49.859850 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:49.861392 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Returning 404 to user: Instance e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:41:49.861392 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-df3c68e9-4ab4-434c-a134-18f6b8fa87c3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee" status: 404 len: 111 microversion: 2.1 time: 0.032726 Jul 02 03:41:49.861392 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 367/743] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:49 2022] GET /compute/v2.1/servers/e218c3f6-e6d6-4ed0-bfbd-976afb92b5ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:41:49.866888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e13afd81-af6b-4e6f-ae36-28e48996174a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '.version_select at 0x7f2e97613c10>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:49.886869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e13afd81-af6b-4e6f-ae36-28e48996174a tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483951310" status: 202 len: 0 microversion: 2.1 time: 0.023988 Jul 02 03:41:49.887773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 377/744] 10.222.0.42 () {58 vars in 1220 bytes} [Sat Jul 2 03:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483951310 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:41:50.556651 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-fc09d81d-75e0-42c9-ab7c-6240034012da req-687970d7-97c3-4900-b845-9a3061b36de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86c62ef-7db9-4c66-be31-20868e93d817", "tag": "41edcc3a-c954-4e67-a0a2-822da68709b0"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:50.565201 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-fc09d81d-75e0-42c9-ab7c-6240034012da req-687970d7-97c3-4900-b845-9a3061b36de0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:50.565637 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-fc09d81d-75e0-42c9-ab7c-6240034012da req-687970d7-97c3-4900-b845-9a3061b36de0 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:50.578276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-fc09d81d-75e0-42c9-ab7c-6240034012da req-687970d7-97c3-4900-b845-9a3061b36de0 service nova] Creating event network-changed:41edcc3a-c954-4e67-a0a2-822da68709b0 for instance e86c62ef-7db9-4c66-be31-20868e93d817 on hv-cinder-84684 Jul 02 03:41:50.583615 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-fc09d81d-75e0-42c9-ab7c-6240034012da req-687970d7-97c3-4900-b845-9a3061b36de0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031129 Jul 02 03:41:50.584288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 368/745] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:52.827219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:52.827781 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:52.829595 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:52.835758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:52.836327 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:52.837098 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:52.837531 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:52.865940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:41:52.953813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c7766f12-b3b3-44af-9677-0bc53afea375 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 204 len: 0 microversion: 2.1 time: 0.130852 Jul 02 03:41:52.954548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 378/746] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:41:52 2022] DELETE /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:41:52.966385 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:52.967226 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:52.973630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:52.974076 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:52.974825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:52.975255 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:53.114158 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:53.126517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1d4c54c4-de51-4e8d-b299-fd765168caf9 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1507 microversion: 2.1 time: 0.165698 Jul 02 03:41:53.127058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 369/747] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:52 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:41:54.144961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:54.145538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:54.152577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:54.153021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:54.153760 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:54.154216 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:54.304931 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:54.306495 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-3e24f5b7-d040-485d-9d9a-1177f5465f44 req-61ef13a5-17f5-48fb-ad56-297d7f98faba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6102b173-1c0f-441b-8d00-2cd53314544d", "name": "network-vif-deleted", "tag": "e02d1bfd-a033-4aa9-9067-1cfc9301fed1"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:54.315320 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-3e24f5b7-d040-485d-9d9a-1177f5465f44 req-61ef13a5-17f5-48fb-ad56-297d7f98faba service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:54.315749 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-3e24f5b7-d040-485d-9d9a-1177f5465f44 req-61ef13a5-17f5-48fb-ad56-297d7f98faba service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:54.320358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-578f3f7b-60eb-4805-af2d-0752e084c838 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 200 len: 1507 microversion: 2.1 time: 0.179440 Jul 02 03:41:54.323081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 379/748] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:54 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:54.330054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-3e24f5b7-d040-485d-9d9a-1177f5465f44 req-61ef13a5-17f5-48fb-ad56-297d7f98faba service nova] Creating event network-vif-deleted:e02d1bfd-a033-4aa9-9067-1cfc9301fed1 for instance 6102b173-1c0f-441b-8d00-2cd53314544d on hv-cinder-84684 Jul 02 03:41:54.335015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-3e24f5b7-d040-485d-9d9a-1177f5465f44 req-61ef13a5-17f5-48fb-ad56-297d7f98faba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032908 Jul 02 03:41:54.336383 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 370/749] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:41:55.340378 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:55.341190 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 6102b173-1c0f-441b-8d00-2cd53314544d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:55.350182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:55.350603 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:55.351976 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:55.352540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:55.366314 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] HTTP exception thrown: Instance 6102b173-1c0f-441b-8d00-2cd53314544d could not be found. Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Request method failure captured: Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d HTTP/1.1 Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7y7bLzPUWFj-NGZjnUbomMq9pCCamrIuGlzdL46FEgS4ugkab4y2M6CbytxBUL8dkybAU6gDY9bUrXa1zy9U6WD5wxDq1C1uLmIU9sloFjK6V5E4AaTr6XlcaOHNRqXcACZxcYpwgyaccNXlLlp85hntILkHdL5-bxVYphqZoabe4w Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:41:55.368185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53c88ba2f03f47538ca0eaeb08ccfc07", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: c941dc00e0584666aba13263b8c1fcb8 Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 6102b173-1c0f-441b-8d00-2cd53314544d could not be found. Jul 02 03:41:55.369606 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '6102b173-1c0f-441b-8d00-2cd53314544d'} Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6102b173-1c0f-441b-8d00-2cd53314544d could not be found. Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:41:55.370431 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6102b173-1c0f-441b-8d00-2cd53314544d could not be found. Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6102b173-1c0f-441b-8d00-2cd53314544d could not be found. Jul 02 03:41:55.372030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:41:55.374015 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Returning 404 to user: Instance 6102b173-1c0f-441b-8d00-2cd53314544d could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:41:55.374015 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e939f363-d53e-420c-82d4-ee6accf60422 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d" status: 404 len: 111 microversion: 2.1 time: 0.033729 Jul 02 03:41:55.374015 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 380/750] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:55 2022] GET /compute/v2.1/servers/6102b173-1c0f-441b-8d00-2cd53314544d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:41:55.379511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:55.380073 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:55.386890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:55.387335 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:55.388115 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:55.388562 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:55.414353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:41:55.494559 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e6a8c5b5-07f8-40e3-bb07-c990da68af05 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 204 len: 0 microversion: 2.1 time: 0.119452 Jul 02 03:41:55.495476 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 371/751] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:41:55 2022] DELETE /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:41:55.507476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:55.508114 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:55.514275 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:55.514720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:55.515761 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:55.516200 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:55.658273 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:55.666447 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-deee11ff-c7f4-4326-ba69-4dd0c33914ce tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.166710 Jul 02 03:41:55.667420 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 381/752] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:55 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:56.687628 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:56.688709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:56.698660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:56.699368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:56.700584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:56.701268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:56.841442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c941dc00e0584666aba13263b8c1fcb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c88ba2f03f47538ca0eaeb08ccfc07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:41:56.849395 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-448f0c29-0e5d-45a4-9042-b2bb66afe9a3 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 200 len: 1520 microversion: 2.1 time: 0.168308 Jul 02 03:41:56.849978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 372/753] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:56 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:41:57.259220 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-9937d434-4241-4463-a87d-8c014b326dcd req-e29bda82-2a15-485e-9bc5-1be504dacd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee71eb-cb9f-458e-96b2-4f6db8156153", "name": "network-vif-deleted", "tag": "1d5c4d80-4bf3-4936-9cbd-a7174cf1642f"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:41:57.268367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-9937d434-4241-4463-a87d-8c014b326dcd req-e29bda82-2a15-485e-9bc5-1be504dacd4e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:57.268808 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-9937d434-4241-4463-a87d-8c014b326dcd req-e29bda82-2a15-485e-9bc5-1be504dacd4e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:57.283548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-9937d434-4241-4463-a87d-8c014b326dcd req-e29bda82-2a15-485e-9bc5-1be504dacd4e service nova] Creating event network-vif-deleted:1d5c4d80-4bf3-4936-9cbd-a7174cf1642f for instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 on hv-cinder-84684 Jul 02 03:41:57.288890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-9937d434-4241-4463-a87d-8c014b326dcd req-e29bda82-2a15-485e-9bc5-1be504dacd4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033676 Jul 02 03:41:57.289836 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 382/754] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:41:57.867582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:41:57.868638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] [instance: 7dee71eb-cb9f-458e-96b2-4f6db8156153] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:41:57.878053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:57.878053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:57.878053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:41:57.878053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:41:57.894086 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] HTTP exception thrown: Instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 could not be found. Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Request method failure captured: Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 HTTP/1.1 Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7y7bLzPUWFj-NGZjnUbomMq9pCCamrIuGlzdL46FEgS4ugkab4y2M6CbytxBUL8dkybAU6gDY9bUrXa1zy9U6WD5wxDq1C1uLmIU9sloFjK6V5E4AaTr6XlcaOHNRqXcACZxcYpwgyaccNXlLlp85hntILkHdL5-bxVYphqZoabe4w Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:41:57.895786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53c88ba2f03f47538ca0eaeb08ccfc07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53c88ba2f03f47538ca0eaeb08ccfc07", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 53c88ba2f03f47538ca0eaeb08ccfc07 Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-998667803 Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: c941dc00e0584666aba13263b8c1fcb8 Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-ServerRescueNegativeTestJSON-998667803-project Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 could not be found. Jul 02 03:41:57.897423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '7dee71eb-cb9f-458e-96b2-4f6db8156153'} Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 could not be found. Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:41:57.898301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 could not be found. Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 could not be found. Jul 02 03:41:57.900011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:41:57.901337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] Returning 404 to user: Instance 7dee71eb-cb9f-458e-96b2-4f6db8156153 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:41:57.901337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8c4383ce-54b0-4931-99cb-8722c5c63fa7 tempest-ServerRescueNegativeTestJSON-998667803 tempest-ServerRescueNegativeTestJSON-998667803-project] 10.222.0.42 "GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153" status: 404 len: 111 microversion: 2.1 time: 0.033944 Jul 02 03:41:57.901510 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 373/755] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:41:57 2022] GET /compute/v2.1/servers/7dee71eb-cb9f-458e-96b2-4f6db8156153 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:42:02.610428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9651c8ed-a7ed-40d0-8893-050a6e096bc1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Action: 'create', calling method: .version_select at 0x7f2e976f0f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2063405417"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:42:02.914972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9651c8ed-a7ed-40d0-8893-050a6e096bc1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.432796 Jul 02 03:42:02.916200 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 383/756] 10.222.0.42 () {60 vars in 1154 bytes} [Sat Jul 2 03:42:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 02 03:42:02.927048 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-37c569e9-4095-4344-9e41-3ae2dba24baa tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e974d89d0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:02.982492 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-37c569e9-4095-4344-9e41-3ae2dba24baa tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994" status: 200 len: 345 microversion: 2.1 time: 0.059161 Jul 02 03:42:02.983181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 374/757] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:02 2022] GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:03.999498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9e1573f4-5096-49f0-a860-6ad4a27e7ebe tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e976d9430>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:04.050362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9e1573f4-5096-49f0-a860-6ad4a27e7ebe tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994" status: 200 len: 346 microversion: 2.1 time: 0.057130 Jul 02 03:42:04.050931 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 384/758] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:03 2022] GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:04.063211 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-503af076-4039-449a-b1fc-e65844492ce1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Action: 'create', calling method: .version_select at 0x7f2e97613940>, body: {"snapshot": {"volume_id": "d8ed3722-a43f-4f21-a1e6-5f7363eee994", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2091473367"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:42:04.217847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-503af076-4039-449a-b1fc-e65844492ce1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.158963 Jul 02 03:42:04.218411 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 375/759] 10.222.0.42 () {60 vars in 1161 bytes} [Sat Jul 2 03:42:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:04.228522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-16b62fe4-1d9d-47b9-b340-93671c5db2db tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e9dea9820>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:04.261269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-16b62fe4-1d9d-47b9-b340-93671c5db2db tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 200 len: 287 microversion: 2.1 time: 0.036588 Jul 02 03:42:04.261840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 385/760] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:04 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:04.271898 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b9046ed6-50c7-4209-a791-48d1157e3057 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e97572700>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:04.303281 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b9046ed6-50c7-4209-a791-48d1157e3057 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035138 Jul 02 03:42:04.303896 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 376/761] 10.222.0.42 () {58 vars in 1139 bytes} [Sat Jul 2 03:42:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:04.314196 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e67d26f4-c37a-431a-b20b-674b1d0153f5 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e976d9430>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:04.354281 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e67d26f4-c37a-431a-b20b-674b1d0153f5 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 200 len: 287 microversion: 2.1 time: 0.043890 Jul 02 03:42:04.354882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 386/762] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:04 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:42:05.367077 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d5976791-5126-4789-b2a3-cb023ba85eec tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e975d15e0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:05.397475 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d5976791-5126-4789-b2a3-cb023ba85eec tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 200 len: 287 microversion: 2.1 time: 0.034867 Jul 02 03:42:05.398042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 377/763] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:05 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:06.415831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d09519d7-fe75-4231-a204-2e07a11b94f0 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e9c197af0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:06.459567 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d09519d7-fe75-4231-a204-2e07a11b94f0 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 200 len: 287 microversion: 2.1 time: 0.051353 Jul 02 03:42:06.460120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 387/764] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:06 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:07.477542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8f301686-4897-4996-b56b-3e356d246f64 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e974d88b0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:07.507261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8f301686-4897-4996-b56b-3e356d246f64 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 200 len: 287 microversion: 2.1 time: 0.037208 Jul 02 03:42:07.507856 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 378/765] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:07 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:08.516563 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:42:08.517325 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:42:08.522482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-12ea549d-07be-4358-a1eb-1276e208c708 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e977b54c0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:08.553790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-12ea549d-07be-4358-a1eb-1276e208c708 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 200 len: 288 microversion: 2.1 time: 0.038076 Jul 02 03:42:08.554350 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 388/766] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:08 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:08.562072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:42:08.562869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:42:08.567764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-392f71d9-78b6-452d-bd65-3b1d0dad0fa2 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e974ce8b0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:08.630114 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-392f71d9-78b6-452d-bd65-3b1d0dad0fa2 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 202 len: 0 microversion: 2.1 time: 0.068393 Jul 02 03:42:08.630944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 379/767] 10.222.0.42 () {58 vars in 1253 bytes} [Sat Jul 2 03:42:08 2022] DELETE /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:42:08.640675 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d687257f-6b5f-4399-8d27-6c8e9602feac tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e9771ac10>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:08.671445 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d687257f-6b5f-4399-8d27-6c8e9602feac tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 200 len: 287 microversion: 2.1 time: 0.035028 Jul 02 03:42:08.672016 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 389/768] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:08 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:09.688398 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1aa371a1-ce19-4609-b131-84d932ec8fc1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e974d83a0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:09.716872 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-1aa371a1-ce19-4609-b131-84d932ec8fc1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] HTTP exception thrown: Snapshot bdea1e86-d391-4c84-88d4-e9075b86b44a could not be found. Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1aa371a1-ce19-4609-b131-84d932ec8fc1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Request method failure captured: Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a HTTP/1.1 Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv76KIjQO4EfPYbQ-mP0mscn2volCJPWUCcOlBVfEJGCVYZBkUPma5-mAY0qJ9_8mYPugtB-9WjRJONd7ewf2DuUPy9Ug6ivgU0RdnG4ER1tO9F3aJSbgsEySh4DVFFPAPMA6q0OEP5hk1gCUfZT1PAzj3oyAhI_JPp47miQbK36godM Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:42:09.719031 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4518933e0bef49e488cce3869465605b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4518933e0bef49e488cce3869465605b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 759d856e88164f7089370be2af314efe Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Snapshot bdea1e86-d391-4c84-88d4-e9075b86b44a could not be found. Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'bdea1e86-d391-4c84-88d4-e9075b86b44a'} Jul 02 03:42:09.720446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bdea1e86-d391-4c84-88d4-e9075b86b44a could not be found. (HTTP 404) (Request-ID: req-714c0aa4-78cc-4e64-81ff-367fb2b6f1b0) Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:09.721257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:09.722480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bdea1e86-d391-4c84-88d4-e9075b86b44a could not be found. Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 02 03:42:09.723878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bdea1e86-d391-4c84-88d4-e9075b86b44a could not be found. Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bdea1e86-d391-4c84-88d4-e9075b86b44a could not be found. Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1aa371a1-ce19-4609-b131-84d932ec8fc1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Returning 404 to user: Snapshot bdea1e86-d391-4c84-88d4-e9075b86b44a could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1aa371a1-ce19-4609-b131-84d932ec8fc1 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a" status: 404 len: 111 microversion: 2.1 time: 0.039590 Jul 02 03:42:09.725348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 380/769] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:09 2022] GET /compute/v2.1/os-snapshots/bdea1e86-d391-4c84-88d4-e9075b86b44a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:42:09.729764 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5fb6e13d-99e3-4456-9dd6-b118ffa90820 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e976135e0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:09.796492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5fb6e13d-99e3-4456-9dd6-b118ffa90820 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994" status: 202 len: 0 microversion: 2.1 time: 0.070944 Jul 02 03:42:09.797042 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 390/770] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:42:09 2022] DELETE /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:42:09.807985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-10e2a2a0-9a87-4171-824e-e23ccc29b218 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e975d1940>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:09.871923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-10e2a2a0-9a87-4171-824e-e23ccc29b218 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994" status: 200 len: 345 microversion: 2.1 time: 0.069655 Jul 02 03:42:09.872731 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 381/771] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:09 2022] GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:42:10.892074 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-40907808-71f1-4f47-b636-1820f0bbcaab tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e9763c310>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:10.924641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-40907808-71f1-4f47-b636-1820f0bbcaab tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] HTTP exception thrown: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-40907808-71f1-4f47-b636-1820f0bbcaab tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Request method failure captured: Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 HTTP/1.1 Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv76KIjQO4EfPYbQ-mP0mscn2volCJPWUCcOlBVfEJGCVYZBkUPma5-mAY0qJ9_8mYPugtB-9WjRJONd7ewf2DuUPy9Ug6ivgU0RdnG4ER1tO9F3aJSbgsEySh4DVFFPAPMA6q0OEP5hk1gCUfZT1PAzj3oyAhI_JPp47miQbK36godM Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:42:10.926697 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4518933e0bef49e488cce3869465605b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4518933e0bef49e488cce3869465605b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 759d856e88164f7089370be2af314efe Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'd8ed3722-a43f-4f21-a1e6-5f7363eee994'} Jul 02 03:42:10.928212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. (HTTP 404) (Request-ID: req-2108f1f9-3575-4d31-9202-d46cb638f9e9) Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:10.929239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:10.930868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 03:42:10.932534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-40907808-71f1-4f47-b636-1820f0bbcaab tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Returning 404 to user: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-40907808-71f1-4f47-b636-1820f0bbcaab tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994" status: 404 len: 109 microversion: 2.1 time: 0.042600 Jul 02 03:42:10.933952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 391/772] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:10 2022] GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:42:10.938626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-223b3b0c-8952-4482-ba1e-8de50e2b2a11 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e9c1a8b80>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:10.967538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-223b3b0c-8952-4482-ba1e-8de50e2b2a11 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] HTTP exception thrown: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-223b3b0c-8952-4482-ba1e-8de50e2b2a11 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Request method failure captured: Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: DELETE /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 HTTP/1.1 Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv76KIjQO4EfPYbQ-mP0mscn2volCJPWUCcOlBVfEJGCVYZBkUPma5-mAY0qJ9_8mYPugtB-9WjRJONd7ewf2DuUPy9Ug6ivgU0RdnG4ER1tO9F3aJSbgsEySh4DVFFPAPMA6q0OEP5hk1gCUfZT1PAzj3oyAhI_JPp47miQbK36godM Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:42:10.969526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4518933e0bef49e488cce3869465605b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4518933e0bef49e488cce3869465605b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 759d856e88164f7089370be2af314efe Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'd8ed3722-a43f-4f21-a1e6-5f7363eee994'} Jul 02 03:42:10.971020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. (HTTP 404) (Request-ID: req-7cc5f60d-5bc7-4696-9fb3-e18d237af677) Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:10.974844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 03:42:10.976245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 02 03:42:10.977496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-223b3b0c-8952-4482-ba1e-8de50e2b2a11 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Returning 404 to user: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-223b3b0c-8952-4482-ba1e-8de50e2b2a11 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994" status: 404 len: 109 microversion: 2.1 time: 0.036673 Jul 02 03:42:10.978882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 382/773] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:42:10 2022] DELETE /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:42:10.980546 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-958e06d6-c28c-4dd3-8feb-80f9ca5bf304 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Calling method '.version_select at 0x7f2e976f0e50>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:11.009088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-958e06d6-c28c-4dd3-8feb-80f9ca5bf304 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] HTTP exception thrown: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-958e06d6-c28c-4dd3-8feb-80f9ca5bf304 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Request method failure captured: Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 HTTP/1.1 Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv76KIjQO4EfPYbQ-mP0mscn2volCJPWUCcOlBVfEJGCVYZBkUPma5-mAY0qJ9_8mYPugtB-9WjRJONd7ewf2DuUPy9Ug6ivgU0RdnG4ER1tO9F3aJSbgsEySh4DVFFPAPMA6q0OEP5hk1gCUfZT1PAzj3oyAhI_JPp47miQbK36godM Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:42:11.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4518933e0bef49e488cce3869465605b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4518933e0bef49e488cce3869465605b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4518933e0bef49e488cce3869465605b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 4518933e0bef49e488cce3869465605b Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846532558 Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 759d856e88164f7089370be2af314efe Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846532558-project Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'd8ed3722-a43f-4f21-a1e6-5f7363eee994'} Jul 02 03:42:11.012543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. (HTTP 404) (Request-ID: req-4ad45af3-866d-4a60-a5f5-5cf083819e45) Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:11.013434 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:11.014719 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 03:42:11.015896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-958e06d6-c28c-4dd3-8feb-80f9ca5bf304 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] Returning 404 to user: Volume d8ed3722-a43f-4f21-a1e6-5f7363eee994 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-958e06d6-c28c-4dd3-8feb-80f9ca5bf304 tempest-VolumesSnapshotsTestJSON-846532558 tempest-VolumesSnapshotsTestJSON-846532558-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994" status: 404 len: 109 microversion: 2.1 time: 0.035794 Jul 02 03:42:11.017013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 392/774] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:10 2022] GET /compute/v2.1/os-volumes/d8ed3722-a43f-4f21-a1e6-5f7363eee994 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 03:42:12.514615 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1929f176-a3f2-4029-ab17-4fd80f1ec3bb tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Action: 'create', calling method: .version_select at 0x7f2e9c1a8b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1433175257", "metadata": {"Type": "work"}}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:42:12.834469 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1929f176-a3f2-4029-ab17-4fd80f1ec3bb tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.446132 Jul 02 03:42:12.835096 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 383/775] 10.222.0.42 () {60 vars in 1155 bytes} [Sat Jul 2 03:42:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 447 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 02 03:42:12.850767 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8eb9fdec-9095-4f62-9286-b9c8073cf145 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Calling method '.version_select at 0x7f2e9dea9e50>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:12.900842 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8eb9fdec-9095-4f62-9286-b9c8073cf145 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7" status: 200 len: 353 microversion: 2.1 time: 0.057722 Jul 02 03:42:12.901793 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 393/776] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:12 2022] GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:13.918368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d907c836-12b6-4501-a5c6-6730c1276337 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Calling method '.version_select at 0x7f2e974ce430>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:13.977414 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d907c836-12b6-4501-a5c6-6730c1276337 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7" status: 200 len: 354 microversion: 2.1 time: 0.065409 Jul 02 03:42:13.977974 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 384/777] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:13 2022] GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:13.990179 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d00219ed-4178-4401-9592-9b51ad38a631 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Calling method '.version_select at 0x7f2e9771af70>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:14.038094 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d00219ed-4178-4401-9592-9b51ad38a631 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7" status: 200 len: 354 microversion: 2.1 time: 0.052207 Jul 02 03:42:14.038661 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 394/778] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:13 2022] GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:14.055614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b75f0d4b-ad75-4067-abc8-3472fa9488e7 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Calling method '.version_select at 0x7f2e97535040>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:14.122427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b75f0d4b-ad75-4067-abc8-3472fa9488e7 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7" status: 202 len: 0 microversion: 2.1 time: 0.070485 Jul 02 03:42:14.123224 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 385/779] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:42:14 2022] DELETE /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:42:14.131355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5fe7b002-3bb4-45a0-96cf-c3fb388c1f25 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Calling method '.version_select at 0x7f2e9771aca0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:14.182979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5fe7b002-3bb4-45a0-96cf-c3fb388c1f25 tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7" status: 200 len: 353 microversion: 2.1 time: 0.055362 Jul 02 03:42:14.183583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 395/780] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:14 2022] GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:15.196299 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-470f02f4-3fde-4755-967c-9a2054ca75ff tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Calling method '.version_select at 0x7f2e9750edc0>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:15.228896 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-470f02f4-3fde-4755-967c-9a2054ca75ff tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] HTTP exception thrown: Volume 6b5a2ada-6b9a-458a-b056-0d077ae85fe7 could not be found. Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-470f02f4-3fde-4755-967c-9a2054ca75ff tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Request method failure captured: Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7 HTTP/1.1 Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv76UUP_kPTkRKHlJpAiuq-HbYIbxrEFZbdU4IGP8aKP_KGy37efGxkW92Om9CnK3WfzkFQOrusQhlRzaAhn8gKWuIi96899uJawGo8RdqP4NN1s626FC24F416N7absvLg6ingJEY4_NxhnhJsqufJdRuMFWDUDXHQCKLtMfHd1ySv8 Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 1248a756a90748f8a6a75053c8cbdb6a Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesGetTestJSON-202132220 Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:42:15.230929 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1248a756a90748f8a6a75053c8cbdb6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1248a756a90748f8a6a75053c8cbdb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1248a756a90748f8a6a75053c8cbdb6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1248a756a90748f8a6a75053c8cbdb6a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesGetTestJSON-202132220 Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 1248a756a90748f8a6a75053c8cbdb6a Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesGetTestJSON-202132220 Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesGetTestJSON-202132220-project Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: bf7b0f5196f1402185c6cf1f2b23f216 Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesGetTestJSON-202132220-project Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Volume 6b5a2ada-6b9a-458a-b056-0d077ae85fe7 could not be found. Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '6b5a2ada-6b9a-458a-b056-0d077ae85fe7'} Jul 02 03:42:15.232649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b5a2ada-6b9a-458a-b056-0d077ae85fe7 could not be found. (HTTP 404) (Request-ID: req-371a7b5d-5f7e-40eb-b156-da63985db59d) Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:15.234387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 03:42:15.236046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b5a2ada-6b9a-458a-b056-0d077ae85fe7 could not be found. Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 03:42:15.238266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b5a2ada-6b9a-458a-b056-0d077ae85fe7 could not be found. Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b5a2ada-6b9a-458a-b056-0d077ae85fe7 could not be found. Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-470f02f4-3fde-4755-967c-9a2054ca75ff tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] Returning 404 to user: Volume 6b5a2ada-6b9a-458a-b056-0d077ae85fe7 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-470f02f4-3fde-4755-967c-9a2054ca75ff tempest-VolumesGetTestJSON-202132220 tempest-VolumesGetTestJSON-202132220-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7" status: 404 len: 109 microversion: 2.1 time: 0.040462 Jul 02 03:42:15.239944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 386/781] 10.222.0.42 () {58 vars in 1244 bytes} [Sat Jul 2 03:42:15 2022] GET /compute/v2.1/os-volumes/6b5a2ada-6b9a-458a-b056-0d077ae85fe7 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:42:39.989194 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:39.989800 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:39.997231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-9d951170-c76c-4fe3-9208-88ea2bf92b7d req-e9c9b54c-08d0-4d15-848d-ca03224a205e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c09baf3-acd2-45b3-bce4-9fd6b31efdac", "tag": "e19a69f0-6e0d-4a86-85f9-02d1861bdf96"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:42:40.007191 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-9d951170-c76c-4fe3-9208-88ea2bf92b7d req-e9c9b54c-08d0-4d15-848d-ca03224a205e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:40.007669 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-9d951170-c76c-4fe3-9208-88ea2bf92b7d req-e9c9b54c-08d0-4d15-848d-ca03224a205e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:40.008102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:40.008556 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:40.009336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:40.009773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:40.018903 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-9d951170-c76c-4fe3-9208-88ea2bf92b7d req-e9c9b54c-08d0-4d15-848d-ca03224a205e service nova] Creating event network-changed:e19a69f0-6e0d-4a86-85f9-02d1861bdf96 for instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac on hv-cinder-84684 Jul 02 03:42:40.024217 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-9d951170-c76c-4fe3-9208-88ea2bf92b7d req-e9c9b54c-08d0-4d15-848d-ca03224a205e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Jul 02 03:42:40.025111 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 387/782] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:40.037001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:42:40.134302 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-59f286c0-7393-42dd-8f35-695b4a47eac3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 204 len: 0 microversion: 2.1 time: 0.149466 Jul 02 03:42:40.135443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 396/783] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:42:39 2022] DELETE /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:42:40.144084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:40.144771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:40.151248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:40.151985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:40.152742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:40.153316 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:40.287015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:40.295084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cac6dc8d-5cc4-45c9-902b-83b2dddc2a6f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.155257 Jul 02 03:42:40.295683 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 388/784] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:40 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:41.313674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:41.314370 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:41.321477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:41.321929 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:41.322703 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:41.323174 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:41.463066 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:41.471495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-731e2b20-6233-49cf-85f0-4fc0c616cdf1 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1568 microversion: 2.1 time: 0.162005 Jul 02 03:42:41.472101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 397/785] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:41 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:42.489951 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:42.490598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:42.497257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:42.497727 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:42.498493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:42.498937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:42.569924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:42.579720 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-14da9dde-55b9-42e8-865f-ca0d9038f91f tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1381 microversion: 2.1 time: 0.093596 Jul 02 03:42:42.580488 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 389/786] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:42 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1381 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:42.612245 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-bb063009-ea0e-4226-ae3d-9d337a5542f0 req-fac2407a-ddfc-413d-8f4e-f49d5733c57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c09baf3-acd2-45b3-bce4-9fd6b31efdac", "name": "network-vif-deleted", "tag": "e19a69f0-6e0d-4a86-85f9-02d1861bdf96"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:42:42.621351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-bb063009-ea0e-4226-ae3d-9d337a5542f0 req-fac2407a-ddfc-413d-8f4e-f49d5733c57f service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:42.621747 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-bb063009-ea0e-4226-ae3d-9d337a5542f0 req-fac2407a-ddfc-413d-8f4e-f49d5733c57f service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:42.632903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-bb063009-ea0e-4226-ae3d-9d337a5542f0 req-fac2407a-ddfc-413d-8f4e-f49d5733c57f service nova] Creating event network-vif-deleted:e19a69f0-6e0d-4a86-85f9-02d1861bdf96 for instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac on hv-cinder-84684 Jul 02 03:42:42.637738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-bb063009-ea0e-4226-ae3d-9d337a5542f0 req-fac2407a-ddfc-413d-8f4e-f49d5733c57f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029142 Jul 02 03:42:42.638348 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 398/787] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:43.596728 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:43.597574 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:43.604418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:43.604944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:43.605818 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:43.606315 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:43.638853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:43.639421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:43.639933 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lazy-loading 'fault' on Instance uuid 1c09baf3-acd2-45b3-bce4-9fd6b31efdac {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:42:43.681157 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f509b8a8e3c4bc3a5143d44c078d939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c04290d87154e48a3bf77a828b563ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:43.689413 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5cab007a-cf39-4459-b342-2b3d6ba46259 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 200 len: 1224 microversion: 2.1 time: 0.096491 Jul 02 03:42:43.695336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 390/788] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:43 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:44.708473 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:44.709203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] [instance: 1c09baf3-acd2-45b3-bce4-9fd6b31efdac] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:44.715474 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:44.715975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:44.716705 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:44.717139 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:44.730623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] HTTP exception thrown: Instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac could not be found. Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Request method failure captured: Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac HTTP/1.1 Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7z-dshEc3ghhXCG8ZmZ_bhxbNvCldLr__ivgKggwbWFKZG9grifs2CnteiQjiTNvCemLI6YsCS88CYWVAfBJ3Es6K5lOcI8vt1zWyE7JbKVGDJ5iHLynZb5GYZVF-HhAkeuk1Eblbp78Y212KAsXyDPy5YbvY1_SO0aMepVkKDzYYg Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 6c04290d87154e48a3bf77a828b563ba Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-TestShelveInstance-947314768 Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:42:44.732848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c04290d87154e48a3bf77a828b563ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c04290d87154e48a3bf77a828b563ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c04290d87154e48a3bf77a828b563ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c04290d87154e48a3bf77a828b563ba", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-TestShelveInstance-947314768 Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 6c04290d87154e48a3bf77a828b563ba Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-TestShelveInstance-947314768 Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-TestShelveInstance-947314768-project Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 4f509b8a8e3c4bc3a5143d44c078d939 Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-TestShelveInstance-947314768-project Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac could not be found. Jul 02 03:42:44.734321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '1c09baf3-acd2-45b3-bce4-9fd6b31efdac'} Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac could not be found. Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:42:44.735234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac could not be found. Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac could not be found. Jul 02 03:42:44.737237 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:42:44.738604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Returning 404 to user: Instance 1c09baf3-acd2-45b3-bce4-9fd6b31efdac could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:42:44.738604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9b11ef24-d121-4a93-b1a5-31fa6e3637b3 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac" status: 404 len: 111 microversion: 2.1 time: 0.031047 Jul 02 03:42:44.738604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 399/789] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:44 2022] GET /compute/v2.1/servers/1c09baf3-acd2-45b3-bce4-9fd6b31efdac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:42:44.914412 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c269efc6-448d-4e03-9803-f3fa74ee1936 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] Calling method '.version_select at 0x7f2e974efc10>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:44.941750 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c269efc6-448d-4e03-9803-f3fa74ee1936 tempest-TestShelveInstance-947314768 tempest-TestShelveInstance-947314768-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-909464848" status: 202 len: 0 microversion: 2.1 time: 0.031077 Jul 02 03:42:44.943089 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 391/790] 10.222.0.42 () {58 vars in 1250 bytes} [Sat Jul 2 03:42:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-909464848 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:42:51.790470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1458909103", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:42:51.859211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] validate_networks() for None {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:42:52.171880 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:42:52.172531 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:42:52.173031 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:42:52.173463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:42:52.173872 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:42:52.183039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:52.183527 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:52.184336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:52.184950 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:52.202850 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Getting quotas for project a713cd9e5960426a9378c54dd45e4997. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:42:52.206799 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Getting quotas for user 2d59b611ec3145d0ba5dc08999f6bdaa and project a713cd9e5960426a9378c54dd45e4997. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:42:52.218641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:42:52.221014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:42:52.269489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cf75c3e8-da02-42f3-a0a8-87bff8579ee9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487204 Jul 02 03:42:52.270220 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 400/791] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:42:52.281055 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e00c532c-a645-472a-a3a6-7f450a29cd0a tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:52.281803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e00c532c-a645-472a-a3a6-7f450a29cd0a tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:52.339519 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e00c532c-a645-472a-a3a6-7f450a29cd0a tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:52.348325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e00c532c-a645-472a-a3a6-7f450a29cd0a tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1215 microversion: 2.1 time: 0.071908 Jul 02 03:42:52.348893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 392/792] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:52 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:53.367269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:53.368081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:53.381748 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:53.382288 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:53.383277 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:53.383984 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:53.464211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:53.473722 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-efae3b8e-8e6d-4b13-bc50-52cf0b4f095d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1275 microversion: 2.1 time: 0.111313 Jul 02 03:42:53.474323 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 401/793] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:53 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:54.491108 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:54.491847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:54.494570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=22 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:42:54.502433 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:54.502890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:54.503691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:54.504462 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:54.645063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:54.652960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-41298748-ffaa-44f0-8713-f30eea82c094 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.165921 Jul 02 03:42:54.653675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 393/794] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:54 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:55.341837 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-62d2a755-3465-47d0-91bf-5a59fccc5f22 req-72f2f070-2443-42fd-8bf8-15ba741fcb04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6319e9c5-17ed-4a1b-ae45-f3547ace512a", "tag": "991e6b72-3175-4681-9cbe-2c587624a608"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:42:55.358492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-62d2a755-3465-47d0-91bf-5a59fccc5f22 req-72f2f070-2443-42fd-8bf8-15ba741fcb04 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:55.358940 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-62d2a755-3465-47d0-91bf-5a59fccc5f22 req-72f2f070-2443-42fd-8bf8-15ba741fcb04 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:55.385027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-62d2a755-3465-47d0-91bf-5a59fccc5f22 req-72f2f070-2443-42fd-8bf8-15ba741fcb04 service nova] Creating event network-changed:991e6b72-3175-4681-9cbe-2c587624a608 for instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a on hv-cinder-84684 Jul 02 03:42:55.409140 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-62d2a755-3465-47d0-91bf-5a59fccc5f22 req-72f2f070-2443-42fd-8bf8-15ba741fcb04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071340 Jul 02 03:42:55.410608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 402/795] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:55.681015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:55.681694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:55.694266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:55.694987 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:55.695874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:55.696326 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:55.978944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:55.986636 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e93fdb44-80ac-4046-a91f-7889565ba1b6 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.320423 Jul 02 03:42:55.987222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 394/796] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:55 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:57.005056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:57.006605 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:57.014655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:57.015102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:57.016127 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:57.016585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:57.228850 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:57.237219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-44a94cba-3589-4de6-b19b-9873bb12f89c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.237256 Jul 02 03:42:57.238195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 403/797] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:56 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:58.256383 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:58.257157 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:58.269591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:58.270075 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:58.270889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:58.271373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:58.488835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:58.497745 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-aad913a1-73f1-43c0-9ab3-b9d72ab53e1c tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.247313 Jul 02 03:42:58.498459 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 395/798] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:58 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:42:58.702967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3a311a17-bdb5-4ba1-9140-8ae9e855218a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:58.704296 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3a311a17-bdb5-4ba1-9140-8ae9e855218a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:58.716591 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3a311a17-bdb5-4ba1-9140-8ae9e855218a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:58.717508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3a311a17-bdb5-4ba1-9140-8ae9e855218a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:58.718462 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3a311a17-bdb5-4ba1-9140-8ae9e855218a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:58.719157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3a311a17-bdb5-4ba1-9140-8ae9e855218a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:58.775486 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3a311a17-bdb5-4ba1-9140-8ae9e855218a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/ips" status: 200 len: 151 microversion: 2.1 time: 0.076740 Jul 02 03:42:58.777925 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 404/799] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:42:58 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/ips => generated 151 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:42:59.514609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:42:59.515456 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:42:59.523182 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:59.523669 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:59.524448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:42:59.524880 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:42:59.706099 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:42:59.715525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d6381ee8-2c44-48d3-8fb0-7dd8ff7aa194 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.205272 Jul 02 03:42:59.716805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 396/800] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:42:59 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:00.248250 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3578696f-0588-4f14-9b41-8cc1a24f796f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:00.249371 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3578696f-0588-4f14-9b41-8cc1a24f796f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:00.257115 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3578696f-0588-4f14-9b41-8cc1a24f796f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:00.257585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3578696f-0588-4f14-9b41-8cc1a24f796f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:00.258366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3578696f-0588-4f14-9b41-8cc1a24f796f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:00.258789 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3578696f-0588-4f14-9b41-8cc1a24f796f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:00.641908 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3578696f-0588-4f14-9b41-8cc1a24f796f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397511 Jul 02 03:43:00.662569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 405/801] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:43:00 2022] POST /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:00.744061 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:00.745506 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:00.763252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:00.764054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:00.765214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:00.765815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:00.985756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:00.995907 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-09386b32-ba8f-4327-be31-61ee66d29972 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.264876 Jul 02 03:43:00.997028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 397/802] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:00 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:43:01.223476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-987a8e34-a065-42e4-bf57-934125e95f46 req-7c66f00e-5ac4-4732-8dd7-6496c3d0342c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6319e9c5-17ed-4a1b-ae45-f3547ace512a", "name": "network-vif-plugged", "status": "completed", "tag": "991e6b72-3175-4681-9cbe-2c587624a608"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:01.238350 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-987a8e34-a065-42e4-bf57-934125e95f46 req-7c66f00e-5ac4-4732-8dd7-6496c3d0342c service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:01.240693 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-987a8e34-a065-42e4-bf57-934125e95f46 req-7c66f00e-5ac4-4732-8dd7-6496c3d0342c service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:01.279432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-987a8e34-a065-42e4-bf57-934125e95f46 req-7c66f00e-5ac4-4732-8dd7-6496c3d0342c service nova] Creating event network-vif-plugged:991e6b72-3175-4681-9cbe-2c587624a608 for instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a on hv-cinder-84684 Jul 02 03:43:01.288238 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-987a8e34-a065-42e4-bf57-934125e95f46 req-7c66f00e-5ac4-4732-8dd7-6496c3d0342c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071112 Jul 02 03:43:01.290147 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 406/803] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:02.017083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:02.017702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:02.026840 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:02.027316 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:02.028190 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:02.028631 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:02.288174 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:02.303364 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d8ad04de-7455-478f-b053-2d6d0d532d85 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.290020 Jul 02 03:43:02.304357 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 398/804] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:02 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:03.321594 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:03.322381 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:03.324852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:03.325770 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=6 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:03.333442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:03.333898 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:03.340840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:03.341276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:03.858558 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:03.868871 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8e839c44-6379-4107-bc26-9dfc6f558fe3 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1315 microversion: 2.1 time: 0.551380 Jul 02 03:43:03.869583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 407/805] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:03 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:04.684421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:04.885926 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:04.886529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:04.894722 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-eb56c7d1-9722-484b-91b4-9cdc591bf56c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Action: 'create', calling method: .version_select at 0x7f2e974d85e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1832884585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSTOiwwKsz9WOc+1ncjBQwq2Qh2EXFVdB7S29DcjOvjOEjy7WwkFJVal/G1Eq5cOiTSYrqeaLJRacU616neTKSHqR3mLgIpq78c1ouZ4DgjRufmnLr4bY/1OTvGn9o1Dg=="}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:04.895787 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:04.896235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:04.896999 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:04.897523 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:04.916796 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-eb56c7d1-9722-484b-91b4-9cdc591bf56c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:43:04.921853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-eb56c7d1-9722-484b-91b4-9cdc591bf56c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for user d42b42214d0d46bbb9fe90aed7f5e382 and project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:43:04.948567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-eb56c7d1-9722-484b-91b4-9cdc591bf56c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.268800 Jul 02 03:43:04.949176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 399/806] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:43:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:05.087083 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:05.097244 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4aac4970-c4f3-4bcf-a311-8dbe8650a657 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1464 microversion: 2.1 time: 0.215010 Jul 02 03:43:05.098611 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 408/807] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:04 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:43:05.142446 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:05.143209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:05.150241 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:05.150689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:05.152547 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:05.153044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:05.182888 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:43:05.282382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-73b52dc7-39c4-4cf0-a2ea-9c2709cbaf45 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 204 len: 0 microversion: 2.1 time: 0.144722 Jul 02 03:43:05.283893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 400/808] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:43:05 2022] DELETE /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:43:05.292507 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:05.293222 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:05.299877 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:05.300473 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:05.301411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:05.301908 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:05.472901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:05.480817 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0a778d45-4149-4a22-a591-98451167190d tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1470 microversion: 2.1 time: 0.192432 Jul 02 03:43:05.481758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 409/809] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:05 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1470 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:06.500461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:06.501092 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:06.515551 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:06.516650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:06.517547 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:06.518403 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:06.656893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:06.665675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f2828446-e705-481b-9332-afae23517691 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1470 microversion: 2.1 time: 0.169362 Jul 02 03:43:06.665675 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 401/810] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:06 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:07.682633 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:07.684480 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:07.696899 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:07.697746 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:07.698727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:07.699366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:07.882146 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:07.891429 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1131654f-5c88-49ad-b445-06ff77a25fc5 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1470 microversion: 2.1 time: 0.212704 Jul 02 03:43:07.892970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 410/811] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:07 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1470 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:08.321580 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:08.322818 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:08.329380 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.329829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.330608 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.331042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.444434 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Invalid volume: volume e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c is already attached to instances: 6ff687e9-ce72-49c7-bb72-f563c433f7af Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: POST /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments HTTP/1.1 Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 74 Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:43:08.446339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {"volumeAttachment": {"volumeId": "e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c"}} Jul 02 03:43:08.447944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Invalid volume: volume e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c is already attached to instances: 6ff687e9-ce72-49c7-bb72-f563c433f7af Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'server_id': '6ff687e9-ce72-49c7-bb72-f563c433f7af', 'body': {'volumeAttachment': {'volumeId': 'e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c'}}} Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c is already attached to instances: 6ff687e9-ce72-49c7-bb72-f563c433f7af Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:08.448853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c is already attached to instances: 6ff687e9-ce72-49c7-bb72-f563c433f7af Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:08.450517 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:43:08.452963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:43:08.452963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:43:08.452963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:43:08.452963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c is already attached to instances: 6ff687e9-ce72-49c7-bb72-f563c433f7af Jul 02 03:43:08.452963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:08.452963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 400 to user: Invalid volume: volume e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c is already attached to instances: 6ff687e9-ce72-49c7-bb72-f563c433f7af {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:43:08.453684 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3af0dfb2-b616-4fa3-aed9-93a049cc1521 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136219 Jul 02 03:43:08.455009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 402/812] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:43:08 2022] POST /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:43:08.503546 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-4bb5c644-e8f6-4e57-b1cc-eaa957690aa3 req-9e284967-3ada-4be4-b8b0-5b4cf7139ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6319e9c5-17ed-4a1b-ae45-f3547ace512a", "name": "network-vif-deleted", "tag": "991e6b72-3175-4681-9cbe-2c587624a608"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:08.513310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-4bb5c644-e8f6-4e57-b1cc-eaa957690aa3 req-9e284967-3ada-4be4-b8b0-5b4cf7139ea7 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.513907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-4bb5c644-e8f6-4e57-b1cc-eaa957690aa3 req-9e284967-3ada-4be4-b8b0-5b4cf7139ea7 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.532886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:08.533536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:08.541765 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.542951 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-4bb5c644-e8f6-4e57-b1cc-eaa957690aa3 req-9e284967-3ada-4be4-b8b0-5b4cf7139ea7 service nova] Creating event network-vif-deleted:991e6b72-3175-4681-9cbe-2c587624a608 for instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a on hv-cinder-84684 Jul 02 03:43:08.543233 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.544487 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.545429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.548705 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-4bb5c644-e8f6-4e57-b1cc-eaa957690aa3 req-9e284967-3ada-4be4-b8b0-5b4cf7139ea7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050650 Jul 02 03:43:08.553267 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 411/813] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:08.662762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lazy-loading 'services' on Instance uuid 6ff687e9-ce72-49c7-bb72-f563c433f7af {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:43:08.746117 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-63b58c25-f0eb-4e23-8fd4-c176a7fad5fb tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments/e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c" status: 202 len: 0 microversion: 2.1 time: 0.218940 Jul 02 03:43:08.746746 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 403/814] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:43:08 2022] DELETE /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments/e9fdbcdb-1b2d-4596-a1a9-703d171a6b7c => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:43:08.756423 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f30eb74f-db87-4949-ac95-773c7fe3d7c6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:08.757420 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f30eb74f-db87-4949-ac95-773c7fe3d7c6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:08.763944 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f30eb74f-db87-4949-ac95-773c7fe3d7c6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.764386 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f30eb74f-db87-4949-ac95-773c7fe3d7c6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.765252 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f30eb74f-db87-4949-ac95-773c7fe3d7c6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.765559 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f30eb74f-db87-4949-ac95-773c7fe3d7c6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.796274 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f30eb74f-db87-4949-ac95-773c7fe3d7c6 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Jul 02 03:43:08.797116 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 412/815] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:43:08 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:08.910150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:08.911199 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:08.917479 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.918193 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.919239 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.919891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.953537 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:08.953994 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:08.954456 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lazy-loading 'fault' on Instance uuid 6319e9c5-17ed-4a1b-ae45-f3547ace512a {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:43:09.005835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d59b611ec3145d0ba5dc08999f6bdaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a713cd9e5960426a9378c54dd45e4997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:09.014234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ae202b60-286c-49aa-93ac-4416de245cc9 tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 200 len: 1305 microversion: 2.1 time: 0.108457 Jul 02 03:43:09.014812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 404/816] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:08 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:09.808367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1f468b78-4269-46fe-8fe2-1f0a3c1c7f72 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:09.809297 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1f468b78-4269-46fe-8fe2-1f0a3c1c7f72 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:09.816453 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f468b78-4269-46fe-8fe2-1f0a3c1c7f72 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:09.816902 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f468b78-4269-46fe-8fe2-1f0a3c1c7f72 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:09.817664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f468b78-4269-46fe-8fe2-1f0a3c1c7f72 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:09.818097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1f468b78-4269-46fe-8fe2-1f0a3c1c7f72 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:09.844321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:09.849077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1f468b78-4269-46fe-8fe2-1f0a3c1c7f72 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Jul 02 03:43:09.849628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 413/817] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:43:09 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:10.031985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:10.032576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] [instance: 6319e9c5-17ed-4a1b-ae45-f3547ace512a] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:10.036232 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:10.040078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:10.040531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:10.041663 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:10.042093 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:10.059545 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] HTTP exception thrown: Instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a could not be found. Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Request method failure captured: Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a HTTP/1.1 Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv766n5I6SiW2rtdsEYRswHR9nyVUn_OOaAqtCSIW1xwXhN_nlC7Ahbu-Y87Mb_mTEkve-9zQmHdJHl67pSzhQS4SJrIbbcB-zEhz71AorfN_y8pQL_8TpIdHzyx1Onm-b5mrPse_1CG3riJ75pgjH7WuyUhm3xCcxBlSBrg7RJb414Y Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: a713cd9e5960426a9378c54dd45e4997 Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-VolumesNegativeTest-1618096875 Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:43:10.061356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a713cd9e5960426a9378c54dd45e4997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a713cd9e5960426a9378c54dd45e4997"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a713cd9e5960426a9378c54dd45e4997"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a713cd9e5960426a9378c54dd45e4997", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-VolumesNegativeTest-1618096875 Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: a713cd9e5960426a9378c54dd45e4997 Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-VolumesNegativeTest-1618096875 Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-VolumesNegativeTest-1618096875-project Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 2d59b611ec3145d0ba5dc08999f6bdaa Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-VolumesNegativeTest-1618096875-project Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a could not be found. Jul 02 03:43:10.062857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '6319e9c5-17ed-4a1b-ae45-f3547ace512a'} Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a could not be found. Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:43:10.063646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a could not be found. Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a could not be found. Jul 02 03:43:10.064826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:10.065924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] Returning 404 to user: Instance 6319e9c5-17ed-4a1b-ae45-f3547ace512a could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:43:10.065924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4b6dc7c1-294c-4245-9aa0-ebebf000c4fa tempest-VolumesNegativeTest-1618096875 tempest-VolumesNegativeTest-1618096875-project] 10.222.0.42 "GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a" status: 404 len: 111 microversion: 2.1 time: 0.035115 Jul 02 03:43:10.065924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 405/818] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:10 2022] GET /compute/v2.1/servers/6319e9c5-17ed-4a1b-ae45-f3547ace512a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:43:10.863670 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cf48d0cb-ced0-4123-9823-accbcc5ceab9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:10.864258 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cf48d0cb-ced0-4123-9823-accbcc5ceab9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:10.867412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:10.873395 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf48d0cb-ced0-4123-9823-accbcc5ceab9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:10.874251 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf48d0cb-ced0-4123-9823-accbcc5ceab9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:10.875094 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf48d0cb-ced0-4123-9823-accbcc5ceab9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:10.875615 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cf48d0cb-ced0-4123-9823-accbcc5ceab9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:10.910228 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cf48d0cb-ced0-4123-9823-accbcc5ceab9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053117 Jul 02 03:43:10.911465 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 414/819] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:43:10 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:43:10.977494 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:10.977987 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:10.987245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:10.987820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:10.988762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:10.989310 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:11.016513 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:43:11.072215 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:11.103629 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6c41b501-563e-4b65-8a1e-206604f4dc5f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 204 len: 0 microversion: 2.1 time: 0.129525 Jul 02 03:43:11.104234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 406/820] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:43:10 2022] DELETE /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:43:11.113574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:11.114422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:11.121484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:11.122294 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:11.126991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:11.129321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:11.277660 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:11.285589 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-99c5997b-7d82-43be-a2a0-23938c56ceed tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1683 microversion: 2.1 time: 0.176177 Jul 02 03:43:11.286321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 415/821] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:11 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:43:12.303753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:12.304448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:12.313668 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:12.314042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:12.314869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:12.315331 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:12.468835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:12.477014 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7c380af5-4df4-41de-a26f-fa60846d4dcd tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1683 microversion: 2.1 time: 0.177567 Jul 02 03:43:12.477591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 407/822] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:12 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:13.494991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:13.495602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:13.502868 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:13.503338 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:13.504153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:13.504585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:13.638762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:13.646468 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b34267f9-b46b-46ce-a5cf-0bb37f5a4d13 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1683 microversion: 2.1 time: 0.156187 Jul 02 03:43:13.647031 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 416/823] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:13 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:14.293842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-796a155e-d484-4978-b620-30f67b992a49 req-256b3804-2343-4aa3-872b-d7b75f3ec335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff687e9-ce72-49c7-bb72-f563c433f7af", "name": "network-vif-deleted", "tag": "41dcd48a-9142-481f-8774-b99c864c98bb"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:14.305106 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-796a155e-d484-4978-b620-30f67b992a49 req-256b3804-2343-4aa3-872b-d7b75f3ec335 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:14.305779 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-796a155e-d484-4978-b620-30f67b992a49 req-256b3804-2343-4aa3-872b-d7b75f3ec335 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:14.318336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-796a155e-d484-4978-b620-30f67b992a49 req-256b3804-2343-4aa3-872b-d7b75f3ec335 service nova] Creating event network-vif-deleted:41dcd48a-9142-481f-8774-b99c864c98bb for instance 6ff687e9-ce72-49c7-bb72-f563c433f7af on hv-cinder-84684 Jul 02 03:43:14.323176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-796a155e-d484-4978-b620-30f67b992a49 req-256b3804-2343-4aa3-872b-d7b75f3ec335 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033464 Jul 02 03:43:14.323976 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 408/824] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:14.664382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:14.665508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:14.674054 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:14.674629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:14.675546 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:14.676184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:14.710333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:14.710786 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:14.711253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lazy-loading 'fault' on Instance uuid 6ff687e9-ce72-49c7-bb72-f563c433f7af {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:43:14.765262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:14.775579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d8d0aaf9-d358-4d6c-904c-fa9da24e822c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 200 len: 1331 microversion: 2.1 time: 0.114837 Jul 02 03:43:14.776463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 417/825] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:14 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:15.795990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=4 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:15.801376 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:15.802113 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:15.809090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:15.809545 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:15.810320 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:15.810761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:15.828987 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af HTTP/1.1 Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:43:15.831466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:43:15.833318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '6ff687e9-ce72-49c7-bb72-f563c433f7af'} Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:43:15.834340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:43:15.836083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:43:15.837638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:43:15.837638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3a38816b-5ef7-404a-ab3b-8e79533bfc37 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 404 len: 111 microversion: 2.1 time: 0.038216 Jul 02 03:43:15.837638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 409/826] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:15 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:43:15.848153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7c6e67ec-79b0-442a-8808-802d3b608dcc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '.version_select at 0x7f2e97731e50>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:15.869781 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7c6e67ec-79b0-442a-8808-802d3b608dcc tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383159877" status: 202 len: 0 microversion: 2.1 time: 0.025610 Jul 02 03:43:15.870675 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 418/827] 10.222.0.42 () {58 vars in 1217 bytes} [Sat Jul 2 03:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383159877 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:43:16.521381 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8f7777bd-7f34-4cb0-b191-19184921b51a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: .version_select at 0x7f2e974cf040>, body: {"keypair": {"name": "tempest-keypair-391208223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIcPwmk34T+ilDlbhU1BJjSKk2XCNQLu+CbpDd5zPiNDoZiU1A/ZlPeqNNtaRwY74B63w3qTnKzmh8yy37qFC0HpEYWTSsDaf48rNAyRbzVY+1i/kcEaqfR7696rdJJSw=="}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:16.536539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-8f7777bd-7f34-4cb0-b191-19184921b51a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:43:16.540740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-8f7777bd-7f34-4cb0-b191-19184921b51a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:43:16.565983 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8f7777bd-7f34-4cb0-b191-19184921b51a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048435 Jul 02 03:43:16.566570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 410/828] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:43:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:17.098650 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2acc8ac5-bbdd-459e-9007-cd335211642d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:17.099365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2acc8ac5-bbdd-459e-9007-cd335211642d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:17.106536 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2acc8ac5-bbdd-459e-9007-cd335211642d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:17.107462 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2acc8ac5-bbdd-459e-9007-cd335211642d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:17.111054 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2acc8ac5-bbdd-459e-9007-cd335211642d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:17.112605 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2acc8ac5-bbdd-459e-9007-cd335211642d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:17.142841 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2acc8ac5-bbdd-459e-9007-cd335211642d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/ips" status: 200 len: 152 microversion: 2.20 time: 0.048574 Jul 02 03:43:17.143844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 419/829] 10.222.0.42 () {60 vars in 1288 bytes} [Sat Jul 2 03:43:17 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 03:43:18.209244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-22058949", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "389311ee-b4f4-4d7f-89a6-51f9bda5ef70"}], "security_groups": [{"name": "tempest-securitygroup--457928793"}], "key_name": "tempest-keypair-391208223", "user_data": "}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:18.318849 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] validate_networks() for [('389311ee-b4f4-4d7f-89a6-51f9bda5ef70', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:43:18.714805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:43:18.715236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:43:18.715764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:43:18.716162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:43:18.716576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:43:18.726251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:18.726703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:18.727542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:18.727979 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:18.745079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:43:18.749339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Getting quotas for user 868e2f0e822b430981369d414eee8e53 and project b44eff44cb504e1f9bf037303db24d1b. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:43:18.760359 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:43:18.762581 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:43:18.816079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e4a3388b-9285-4679-b282-3a56e7de1243 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.611624 Jul 02 03:43:18.816708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 411/830] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:43:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:43:18.826682 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f93071b8-9d81-4cad-a37e-c33a45a2773e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:18.827287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f93071b8-9d81-4cad-a37e-c33a45a2773e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:18.882001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f93071b8-9d81-4cad-a37e-c33a45a2773e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:18.888814 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f93071b8-9d81-4cad-a37e-c33a45a2773e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1239 microversion: 2.1 time: 0.065881 Jul 02 03:43:18.889365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 420/831] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:18 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:18.995441 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:18.996234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:19.005295 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:19.006058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:19.007795 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:19.008863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:19.037692 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lazy-loading 'flavor' on Instance uuid e86c62ef-7db9-4c66-be31-20868e93d817 {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:43:19.316354 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dba44af9-eeeb-4c4a-a8b5-a1133f27e5f1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/action" status: 202 len: 0 microversion: 2.20 time: 0.324701 Jul 02 03:43:19.319393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 412/832] 10.222.0.42 () {62 vars in 1318 bytes} [Sat Jul 2 03:43:18 2022] POST /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:43:19.326179 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:19.327002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:19.334618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:19.336773 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:19.337617 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:19.338047 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:19.479848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:19.492106 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:19.494305 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:19.496124 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-40860a1b-aadf-45b7-a4cb-c7d5b868a692 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.173838 Jul 02 03:43:19.497155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 421/833] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:19 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:19.905822 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:19.906671 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:19.913254 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:19.913977 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:19.914803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:19.915413 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:19.981622 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:19.989632 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-22f96858-eac6-4c55-8477-1e33f2d058ae tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1299 microversion: 2.1 time: 0.088140 Jul 02 03:43:19.990196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 413/834] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:19 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:20.517296 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:20.518039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:20.524813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:20.525260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:20.526018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:20.526421 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:20.661672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:20.670194 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:20.671806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:20.672890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-22c72714-3c0e-4095-8a73-3a7760f42e04 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.159679 Jul 02 03:43:20.673895 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 422/835] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:20 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:21.007452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:21.008150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:21.015169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:21.015647 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:21.016412 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:21.016888 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:21.153737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:21.161361 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ac80f415-e576-4deb-9950-b97a5dbace80 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.158267 Jul 02 03:43:21.161934 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 414/836] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:21 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:21.529064 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-54979054-f345-40ff-8bbe-66d03934c884 req-12c440bd-ed22-4a11-b34f-de8631b34ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af2c7ed-c01c-4f12-a9c9-28129e849bdc", "tag": "69d4d9fb-1309-4a88-8717-b17ebe2b00bd"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:21.538322 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-54979054-f345-40ff-8bbe-66d03934c884 req-12c440bd-ed22-4a11-b34f-de8631b34ab8 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:21.538756 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-54979054-f345-40ff-8bbe-66d03934c884 req-12c440bd-ed22-4a11-b34f-de8631b34ab8 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:21.551270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-54979054-f345-40ff-8bbe-66d03934c884 req-12c440bd-ed22-4a11-b34f-de8631b34ab8 service nova] Creating event network-changed:69d4d9fb-1309-4a88-8717-b17ebe2b00bd for instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc on hv-cinder-84684 Jul 02 03:43:21.556239 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-54979054-f345-40ff-8bbe-66d03934c884 req-12c440bd-ed22-4a11-b34f-de8631b34ab8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030910 Jul 02 03:43:21.556814 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 423/837] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:21.691378 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:21.692046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:21.698180 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:21.698623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:21.699400 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:21.699842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:21.830710 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:21.839283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:21.840802 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:21.841968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7afd2f0f-d126-48bb-aa30-2ba4217bdbb4 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.154796 Jul 02 03:43:21.842499 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 415/838] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:21 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:22.179575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:22.180268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:22.186891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:22.187326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:22.188312 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:22.189332 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:22.322111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:22.329936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-726fe3d1-c35c-4798-b96e-22852514f443 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.154658 Jul 02 03:43:22.330509 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 424/839] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:22 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:22.860912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:22.861471 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:22.868830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:22.869284 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:22.870087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:22.870531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:23.018868 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:23.026983 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:23.028496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:23.029650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f24160f4-da5f-440d-8ae5-e494d493830c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.172920 Jul 02 03:43:23.030505 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 416/840] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:22 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:23.348417 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:23.349021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:23.355955 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:23.356395 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:23.357149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:23.357573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:23.496577 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:23.506128 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-969f05f7-d7dc-4bf1-af50-fdc60ebdf2e8 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.162202 Jul 02 03:43:23.506713 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 425/841] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:23 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:24.054159 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:24.054789 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:24.061792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:24.062236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:24.062992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:24.063466 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:24.195986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:24.204579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:24.206387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:24.207586 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dff544b0-37b4-4a6a-8c11-ae4666a732e9 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.157760 Jul 02 03:43:24.208147 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 417/842] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:24 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:24.522793 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:24.523547 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:24.530618 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:24.531049 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:24.531840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:24.532269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:24.672059 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:24.683698 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-28eafefe-5c1a-44fd-b9c8-16734135c763 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.164975 Jul 02 03:43:24.684474 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 426/843] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:24 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:25.226100 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:25.226749 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:25.233756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:25.234207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:25.234970 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:25.235447 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:25.385536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:25.394445 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:25.396234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:25.397521 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-89c52920-4680-4426-86a7-c3e3c3c6e442 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.175334 Jul 02 03:43:25.398052 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 418/844] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:25 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:25.702529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:25.703111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:25.710197 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:25.710604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:25.711412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:25.711849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:25.849688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:25.857338 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-18b9c103-4f99-4f16-a2cb-1fc85a9a828a tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.158869 Jul 02 03:43:25.857909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 427/845] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:25 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:26.425523 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:26.425523 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:26.438952 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:26.440112 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:26.441106 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:26.441551 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:26.578294 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:26.586532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:26.588051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:26.589234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b0e1842a-f39e-4497-b251-f4c415bcd406 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.171875 Jul 02 03:43:26.589788 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 419/846] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:26 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:26.874468 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:26.875108 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:26.882293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:26.882807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:26.883787 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:26.884217 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:27.021072 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:27.028665 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-db52bbb5-a8cf-4fc8-ae44-588b28d6bfa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.158314 Jul 02 03:43:27.029231 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 428/847] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:26 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:27.607949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:27.608545 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:27.615744 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:27.616187 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:27.616963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:27.617402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:27.758289 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:27.766342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:27.767871 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:27.769050 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8f902710-3020-4071-972f-eca19030d203 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.165222 Jul 02 03:43:27.769582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 420/848] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:27 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:28.051805 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:28.052384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:28.060617 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:28.061100 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:28.061851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:28.062278 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:28.206943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:28.214593 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2fd251f9-fe0b-43f6-bc73-2a80a6440681 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.168931 Jul 02 03:43:28.215142 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 429/849] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:28 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:28.785794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:28.786982 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=10 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:28.790792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:28.791746 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:28.795195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-aed65e5c-58f4-4750-ac93-9bd5256e7e12 req-c8ef0152-c6f5-40a8-b8d1-45ba52543ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af2c7ed-c01c-4f12-a9c9-28129e849bdc", "name": "network-vif-plugged", "status": "completed", "tag": "69d4d9fb-1309-4a88-8717-b17ebe2b00bd"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:28.798979 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:28.799550 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:28.800423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:28.801057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:28.813522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-aed65e5c-58f4-4750-ac93-9bd5256e7e12 req-c8ef0152-c6f5-40a8-b8d1-45ba52543ddf service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:28.814052 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-aed65e5c-58f4-4750-ac93-9bd5256e7e12 req-c8ef0152-c6f5-40a8-b8d1-45ba52543ddf service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:28.828310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-aed65e5c-58f4-4750-ac93-9bd5256e7e12 req-c8ef0152-c6f5-40a8-b8d1-45ba52543ddf service nova] Creating event network-vif-plugged:69d4d9fb-1309-4a88-8717-b17ebe2b00bd for instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc on hv-cinder-84684 Jul 02 03:43:28.840046 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-aed65e5c-58f4-4750-ac93-9bd5256e7e12 req-c8ef0152-c6f5-40a8-b8d1-45ba52543ddf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048783 Jul 02 03:43:28.841634 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 430/850] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:29.097342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:29.106151 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:29.107813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:29.109238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8d410972-0d4a-4e5c-bb2a-e08cb3ae0f7d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.325931 Jul 02 03:43:29.109978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 421/851] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:28 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:29.232275 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:29.232966 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:29.234925 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:29.241115 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:29.241682 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:29.242403 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:29.242839 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:29.389712 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:29.398143 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-eeb9c2e3-cd29-4f58-9bfe-563ca4ce9ad7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.170097 Jul 02 03:43:29.398716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 431/852] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:29 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:30.012085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-752443387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832884585", "security_groups": [{"name": "tempest-secgroup-smoke-500091931"}], "block_device_mapping_v2": [{"uuid": "e810c146-c549-4643-92fb-f32a04d6986e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f1ef0821-e2dc-4511-8f33-8aac33bfb07d"}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:30.128489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:30.129675 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:30.135192 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:30.135727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:30.136573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:30.137001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:30.140816 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] validate_networks() for [('f1ef0821-e2dc-4511-8f33-8aac33bfb07d', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:43:30.338289 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:30.346659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:30.348209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:30.349376 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fcf9d537-d84c-45b1-9a09-c108e00f7b77 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.224874 Jul 02 03:43:30.349941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 432/853] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:30 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:43:30.414324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:30.414971 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:30.421795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:30.422234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:30.422992 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:30.423456 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:30.635033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:30.638492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:30.643657 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-788db8a9-9113-4761-a2ad-b31fcbec2298 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1364 microversion: 2.1 time: 0.233164 Jul 02 03:43:30.644242 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 433/854] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:30 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:30.656181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:43:30.656602 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:43:30.657072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:43:30.657473 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:43:30.657882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:43:30.667903 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:30.668341 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:30.669136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:30.669567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:30.686708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:43:30.691095 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for user d42b42214d0d46bbb9fe90aed7f5e382 and project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:43:30.749200 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:43:30.751309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e810c146-c549-4643-92fb-f32a04d6986e',volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:43:30.899081 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9e86e4d4-dc30-4ddb-afb3-905df196ab4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.890920 Jul 02 03:43:30.899803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 422/855] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:43:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 03:43:30.910541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0965d4ac-019f-42e4-8159-641530d0a7c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:30.911184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0965d4ac-019f-42e4-8159-641530d0a7c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:30.965978 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0965d4ac-019f-42e4-8159-641530d0a7c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:30.973387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0965d4ac-019f-42e4-8159-641530d0a7c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1094 microversion: 2.1 time: 0.067390 Jul 02 03:43:30.974151 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 434/856] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:30 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:31.368754 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:31.369309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:31.376052 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:31.376496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:31.377257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:31.377736 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:31.515198 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:31.523829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:31.525331 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:31.526505 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e57ce4db-38ba-4993-b2de-632e07aab349 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1743 microversion: 2.20 time: 0.162688 Jul 02 03:43:31.527107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 423/857] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:31 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:31.663970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:31.664624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:31.672364 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:31.672869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:31.673684 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:31.674162 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:31.808997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:31.821229 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-0e0bfbc3-1f3e-4163-87d7-5918f21c6943 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1554 microversion: 2.1 time: 0.161081 Jul 02 03:43:31.821916 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 435/858] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:31 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:31.838268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e0900f46-195d-4b65-aa0d-7d33af198c4b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:31.838753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e0900f46-195d-4b65-aa0d-7d33af198c4b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:31.845054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e0900f46-195d-4b65-aa0d-7d33af198c4b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:31.845504 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e0900f46-195d-4b65-aa0d-7d33af198c4b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:31.846354 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e0900f46-195d-4b65-aa0d-7d33af198c4b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:31.846896 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e0900f46-195d-4b65-aa0d-7d33af198c4b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:31.925688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e0900f46-195d-4b65-aa0d-7d33af198c4b tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091291 Jul 02 03:43:31.926274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 424/859] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:43:31 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:31.991218 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:31.992384 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:31.999928 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:32.000762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:32.001804 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:32.002678 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:32.099018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:32.109334 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4767759e-255a-4c22-85b7-d8ad9b9ebfba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1210 microversion: 2.1 time: 0.122940 Jul 02 03:43:32.109907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 436/860] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:31 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:32.547090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:32.548761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:32.556949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:32.557406 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:32.558211 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:32.558944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:32.578689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:32.987238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:33.002938 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:33.009557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:33.011820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d999b970-b52f-404a-9ad2-6d195d57d4bc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1743 microversion: 2.20 time: 0.469320 Jul 02 03:43:33.031480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 425/861] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:32 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1743 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:33.126305 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:33.126946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:33.138883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:33.139671 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:33.140673 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:33.141311 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:33.400821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:33.408986 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2fe9f01e-6f80-458e-853f-2c05df616c74 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.286559 Jul 02 03:43:33.409911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 437/862] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:33 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:33.479657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-a611b080-65ec-4b6a-8566-28bd0e2e3452 req-e284122a-9030-4efb-ad6e-cdf1aff2ae78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af2c7ed-c01c-4f12-a9c9-28129e849bdc", "tag": "69d4d9fb-1309-4a88-8717-b17ebe2b00bd"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:33.493148 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-a611b080-65ec-4b6a-8566-28bd0e2e3452 req-e284122a-9030-4efb-ad6e-cdf1aff2ae78 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:33.493602 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-a611b080-65ec-4b6a-8566-28bd0e2e3452 req-e284122a-9030-4efb-ad6e-cdf1aff2ae78 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:33.511544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-a611b080-65ec-4b6a-8566-28bd0e2e3452 req-e284122a-9030-4efb-ad6e-cdf1aff2ae78 service nova] Creating event network-changed:69d4d9fb-1309-4a88-8717-b17ebe2b00bd for instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc on hv-cinder-84684 Jul 02 03:43:33.519482 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-a611b080-65ec-4b6a-8566-28bd0e2e3452 req-e284122a-9030-4efb-ad6e-cdf1aff2ae78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043136 Jul 02 03:43:33.520939 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 426/863] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:33.591857 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-8d579458-dddb-498e-b705-de567ac9606c req-ab0462bd-7ad2-4d93-bcb3-74237aa16f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0acb8d-32fc-45d8-92c5-50acf318209b", "tag": "aec144f9-1629-4a8c-81b5-4db1c91d876d"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:33.601350 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-8d579458-dddb-498e-b705-de567ac9606c req-ab0462bd-7ad2-4d93-bcb3-74237aa16f63 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:33.602161 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-8d579458-dddb-498e-b705-de567ac9606c req-ab0462bd-7ad2-4d93-bcb3-74237aa16f63 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:33.622146 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-8d579458-dddb-498e-b705-de567ac9606c req-ab0462bd-7ad2-4d93-bcb3-74237aa16f63 service nova] Creating event network-changed:aec144f9-1629-4a8c-81b5-4db1c91d876d for instance ea0acb8d-32fc-45d8-92c5-50acf318209b on hv-cinder-84684 Jul 02 03:43:33.633289 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-8d579458-dddb-498e-b705-de567ac9606c req-ab0462bd-7ad2-4d93-bcb3-74237aa16f63 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044914 Jul 02 03:43:33.634155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 438/864] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:34.038145 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:34.039582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:34.046375 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:34.047054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:34.048034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:34.048652 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:34.191650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:34.201277 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:34.202759 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:34.203953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d1634902-a8af-44bd-ae71-6c44bd36e587 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1743 microversion: 2.20 time: 0.170808 Jul 02 03:43:34.204522 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 427/865] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:34 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 03:43:34.427766 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:34.428455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:34.435103 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:34.435596 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:34.436394 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:34.436834 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:34.569742 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:34.577720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-89072bb3-b340-48c5-b0d3-31bb6d307be6 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.155265 Jul 02 03:43:34.578639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 439/866] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:34 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:34.792542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-90c5a21f-1249-4bfc-8171-a60628086c9c req-43ee6d41-be20-4e23-bd5c-083fe76e2396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86c62ef-7db9-4c66-be31-20868e93d817", "name": "network-vif-plugged", "status": "completed", "tag": "41edcc3a-c954-4e67-a0a2-822da68709b0"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:34.801591 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-90c5a21f-1249-4bfc-8171-a60628086c9c req-43ee6d41-be20-4e23-bd5c-083fe76e2396 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:34.802101 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-90c5a21f-1249-4bfc-8171-a60628086c9c req-43ee6d41-be20-4e23-bd5c-083fe76e2396 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:34.816740 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-90c5a21f-1249-4bfc-8171-a60628086c9c req-43ee6d41-be20-4e23-bd5c-083fe76e2396 service nova] Creating event network-vif-plugged:41edcc3a-c954-4e67-a0a2-822da68709b0 for instance e86c62ef-7db9-4c66-be31-20868e93d817 on hv-cinder-84684 Jul 02 03:43:34.821794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-90c5a21f-1249-4bfc-8171-a60628086c9c req-43ee6d41-be20-4e23-bd5c-083fe76e2396 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Jul 02 03:43:34.822539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 428/867] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:35.225648 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:35.226446 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:35.234824 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:35.235467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:35.236487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:35.237061 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:35.375394 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:35.386421 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:35.388526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:35.390219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d09177ec-9fda-47b3-a17d-3627e2a18472 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1743 microversion: 2.20 time: 0.170631 Jul 02 03:43:35.390993 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 440/868] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:35 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:35.598680 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:35.599541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:35.606884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:35.607425 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:35.608319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:35.608820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:35.746654 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:35.754817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0764dcb2-cf79-426c-99f1-ff0bd409385b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.162232 Jul 02 03:43:35.755391 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 429/869] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:35 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:36.410593 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:36.411152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:36.418373 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:36.418828 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:36.419634 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:36.420070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:36.562411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:36.570876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:36.572379 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:36.573529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-95c9436e-bd1a-4f78-8b22-9a9e90ee53ed tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1743 microversion: 2.20 time: 0.167048 Jul 02 03:43:36.574082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 441/870] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:36 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:36.771802 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:36.772422 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:36.779578 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:36.780020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:36.780785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:36.781214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:36.917792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:36.925928 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9d162cd5-0699-4e92-a3cd-9666a771863b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.157717 Jul 02 03:43:36.926557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 430/871] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:36 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:37.596718 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:37.598405 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:37.609166 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:37.610008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:37.610892 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:37.611404 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:37.769514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:37.777810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:37.779551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:37.780726 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fe379588-770f-43cb-9911-b119a2c10166 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.191752 Jul 02 03:43:37.781274 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 442/872] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:37 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:37.943630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:37.944349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:37.946876 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:37.956324 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:37.956873 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:37.957912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:37.958410 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:38.125584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:38.136705 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-add123a6-ef7e-401c-9c63-6e633e6d7cb2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.197414 Jul 02 03:43:38.142829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 431/873] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:37 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:38.800163 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:38.801063 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:38.807938 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:38.808383 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:38.809155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:38.809984 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:38.953393 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:38.962901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:38.964602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:38.965968 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6e7c32fb-799f-4656-aec3-f834f23637cf tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.170301 Jul 02 03:43:38.967078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 443/874] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:38 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:39.159452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:39.160678 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:39.168079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:39.168733 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:39.169662 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:39.170091 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:39.341612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:39.355401 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cdb64cfa-fae5-42e0-a6c6-fc772e03994f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.199981 Jul 02 03:43:39.356007 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 432/875] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:39 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:39.984739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:39.985313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:39.992886 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:39.993639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:39.994640 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:39.995079 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:40.136058 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:40.144526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:40.145938 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:40.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-21fbdc9e-82d8-4f14-a168-5309b0d2941a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.166317 Jul 02 03:43:40.147737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 444/876] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:39 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:40.371870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:40.373116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:40.380353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:40.380914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:40.381756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:40.382260 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:40.520677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:40.528493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0ccdc848-b1dc-449f-9063-5c3d53586139 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.160619 Jul 02 03:43:40.529068 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 433/877] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:40 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:41.165758 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:41.166768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:41.168774 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:41.169876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:41.175702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:41.176159 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:41.178991 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:41.179479 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:41.336938 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:41.345584 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:41.347441 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:41.348617 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1cb87e7b-1031-4c6d-a38b-b2bf617cc455 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.187141 Jul 02 03:43:41.350597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 445/878] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:41 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:41.546654 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:41.547324 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:41.549217 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:41.549942 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:41.556751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:41.557177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:41.557937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:41.558546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:41.704261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:41.713638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-efa60bd7-592a-49fc-84f9-b9804403f622 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.170717 Jul 02 03:43:41.723274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 434/879] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:41 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:42.368022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:42.369192 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:42.379568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:42.380148 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:42.380894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:42.381851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:42.554153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:42.562368 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:42.563877 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:42.565343 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7ec1801e-db54-4a19-93db-e258dc41444b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.201170 Jul 02 03:43:42.565906 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 446/880] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:42 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:42.730596 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:42.731860 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:42.739634 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:42.740365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:42.741104 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:42.741746 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:42.908081 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:42.916220 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1c739c41-319f-49e2-be8f-39d043d4521e tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.189415 Jul 02 03:43:42.917072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 435/881] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:42 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:43.590883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:43.591506 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:43.601412 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:43.601858 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:43.602646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:43.603082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:43.790130 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:43.804372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:43.806002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:43.807270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-97e0550d-400e-434f-9cb3-1d839e8096dd tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.221162 Jul 02 03:43:43.819204 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 447/882] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:43 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:43.934233 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:43.934985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:43.944084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:43.944876 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:43.945970 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:43.947174 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:44.104375 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:44.120567 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3fa0084b-9287-4868-8feb-19564eb5cebd tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.190412 Jul 02 03:43:44.121241 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 436/883] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:43 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:44.826213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:44.827795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:44.836916 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:44.837610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:44.838593 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:44.839266 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:44.892808 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-079d5e96-4994-4702-8742-7804f2668344 req-006594d3-54e3-4f4c-bf41-75f0cb6c16cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0acb8d-32fc-45d8-92c5-50acf318209b", "name": "network-vif-plugged", "status": "completed", "tag": "aec144f9-1629-4a8c-81b5-4db1c91d876d"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:44.905515 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-079d5e96-4994-4702-8742-7804f2668344 req-006594d3-54e3-4f4c-bf41-75f0cb6c16cd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:44.915764 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-079d5e96-4994-4702-8742-7804f2668344 req-006594d3-54e3-4f4c-bf41-75f0cb6c16cd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:44.928198 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-079d5e96-4994-4702-8742-7804f2668344 req-006594d3-54e3-4f4c-bf41-75f0cb6c16cd service nova] Creating event network-vif-plugged:aec144f9-1629-4a8c-81b5-4db1c91d876d for instance ea0acb8d-32fc-45d8-92c5-50acf318209b on hv-cinder-84684 Jul 02 03:43:44.941091 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-079d5e96-4994-4702-8742-7804f2668344 req-006594d3-54e3-4f4c-bf41-75f0cb6c16cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060128 Jul 02 03:43:44.947677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 437/884] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:43:45.031827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:45.042335 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:45.043863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:45.045116 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5f0acb31-c007-4e05-8f42-53e927758368 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.222993 Jul 02 03:43:45.045901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 448/885] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:44 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:45.143478 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:45.144656 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:45.152094 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:45.152657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:45.153522 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:45.154027 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:45.336786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:45.347730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ac86de8c-0ec6-4585-8234-f36212717059 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.209583 Jul 02 03:43:45.348518 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 438/886] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:45 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:46.068310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:46.069351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:46.080408 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:46.081196 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:46.082152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:46.082589 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:46.220526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:46.229006 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:46.230499 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:46.231688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-08550d6c-01fe-4eb4-804b-76014d73932f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1738 microversion: 2.20 time: 0.170257 Jul 02 03:43:46.232225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 449/887] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:46 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:46.365236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:46.365782 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:46.372870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:46.373316 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:46.374081 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:46.374512 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:46.533866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:46.542323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-90b075ad-c9d9-4c3c-bb9c-67e5700f8bde tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1265 microversion: 2.1 time: 0.181338 Jul 02 03:43:46.542879 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 439/888] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:46 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:47.250310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:47.250901 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:47.258269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:47.258730 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:47.259535 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:47.259967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:47.393216 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:47.401297 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:47.402772 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:47.403961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-69a2907c-98e2-4342-bf58-c9870f361cce tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1720 microversion: 2.20 time: 0.157774 Jul 02 03:43:47.404515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 450/889] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:47 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:47.563737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:47.564776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:47.577426 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:47.578167 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:47.579490 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:47.580231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:47.727140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:47.735044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-40a3a344-5604-4689-a35e-91987df0732d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1452 microversion: 2.1 time: 0.178018 Jul 02 03:43:47.735646 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 440/890] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:47 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:47.751597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:47.752249 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:47.758586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:47.759067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:47.759869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:47.760303 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:47.902171 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:47.910215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1dc70f56-1008-4001-bfea-92fa6ba3326d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1452 microversion: 2.1 time: 0.162471 Jul 02 03:43:47.910793 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 451/891] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:43:47 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:43:48.423687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:48.425067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:48.431805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:48.432263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:48.433042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:48.433447 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:48.653177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:48.661921 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:48.663414 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:48.664564 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fc0101cd-5e1f-4b8b-b84a-c487c8b3f691 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1720 microversion: 2.20 time: 0.244971 Jul 02 03:43:48.665107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 441/892] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:48 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:49.684123 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:49.684813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:49.691584 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:49.692541 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:49.693076 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:49.693512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:49.697916 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=100 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:49.782679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-1caa165a-2cfb-491c-bf44-b36a91ff4a2b req-1c3f02c2-6115-4b0b-8d77-841e42fc8ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0acb8d-32fc-45d8-92c5-50acf318209b", "tag": "aec144f9-1629-4a8c-81b5-4db1c91d876d"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:49.792742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-1caa165a-2cfb-491c-bf44-b36a91ff4a2b req-1c3f02c2-6115-4b0b-8d77-841e42fc8ee6 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:49.793415 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-1caa165a-2cfb-491c-bf44-b36a91ff4a2b req-1c3f02c2-6115-4b0b-8d77-841e42fc8ee6 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:49.805633 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-1caa165a-2cfb-491c-bf44-b36a91ff4a2b req-1c3f02c2-6115-4b0b-8d77-841e42fc8ee6 service nova] Creating event network-changed:aec144f9-1629-4a8c-81b5-4db1c91d876d for instance ea0acb8d-32fc-45d8-92c5-50acf318209b on hv-cinder-84684 Jul 02 03:43:49.810704 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-1caa165a-2cfb-491c-bf44-b36a91ff4a2b req-1c3f02c2-6115-4b0b-8d77-841e42fc8ee6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032262 Jul 02 03:43:49.811419 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 442/893] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:43:49.848954 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:49.857240 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:49.858889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:49.860085 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9180cae7-67ac-4fc7-9f22-d26246d7f80d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1720 microversion: 2.20 time: 0.180733 Jul 02 03:43:49.871267 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 452/894] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:49 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:50.826205 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-254f6a0b-c354-4a1d-af2f-98df32e06d30 req-21aae149-2bb8-4866-bf10-322e920f1efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86c62ef-7db9-4c66-be31-20868e93d817", "name": "network-vif-unplugged", "status": "completed", "tag": "41edcc3a-c954-4e67-a0a2-822da68709b0"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:50.835344 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-254f6a0b-c354-4a1d-af2f-98df32e06d30 req-21aae149-2bb8-4866-bf10-322e920f1efd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:50.835894 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-254f6a0b-c354-4a1d-af2f-98df32e06d30 req-21aae149-2bb8-4866-bf10-322e920f1efd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:50.847431 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.compute.server_external_events [req-254f6a0b-c354-4a1d-af2f-98df32e06d30 req-21aae149-2bb8-4866-bf10-322e920f1efd service nova] Unable to find a host for instance e86c62ef-7db9-4c66-be31-20868e93d817. Dropping event network-vif-unplugged {{(pid=124513) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 02 03:43:50.848310 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-254f6a0b-c354-4a1d-af2f-98df32e06d30 req-21aae149-2bb8-4866-bf10-322e920f1efd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027562 Jul 02 03:43:50.848878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 443/895] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 02 03:43:50.878803 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:50.879652 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:50.887904 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:50.888640 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:50.889536 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:50.890269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.033276 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:51.042361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:51.043961 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:51.045091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-47e06ec5-3f2b-4aa2-a8b8-601b4956d8a3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1663 microversion: 2.20 time: 0.170892 Jul 02 03:43:51.045642 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 453/896] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:50 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:51.063114 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-57f369a5-4cfc-48f7-9ad4-45996e1a72f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "831b15b3-cdf0-43cb-97ea-732858d46d55"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:51.064324 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-57f369a5-4cfc-48f7-9ad4-45996e1a72f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:51.070666 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57f369a5-4cfc-48f7-9ad4-45996e1a72f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.071118 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57f369a5-4cfc-48f7-9ad4-45996e1a72f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.071904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57f369a5-4cfc-48f7-9ad4-45996e1a72f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.072309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-57f369a5-4cfc-48f7-9ad4-45996e1a72f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.251010 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:51.365421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-57f369a5-4cfc-48f7-9ad4-45996e1a72f8 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306234 Jul 02 03:43:51.366075 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 444/897] 10.222.0.42 () {62 vars in 1363 bytes} [Sat Jul 2 03:43:51 2022] POST /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 03:43:51.498279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a414764a-d47e-45dd-b77e-91da48273e71 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:51.498707 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a414764a-d47e-45dd-b77e-91da48273e71 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:51.505178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a414764a-d47e-45dd-b77e-91da48273e71 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.505628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a414764a-d47e-45dd-b77e-91da48273e71 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.506399 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a414764a-d47e-45dd-b77e-91da48273e71 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.506823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a414764a-d47e-45dd-b77e-91da48273e71 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.771210 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a414764a-d47e-45dd-b77e-91da48273e71 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-volume_attachments/831b15b3-cdf0-43cb-97ea-732858d46d55" status: 202 len: 0 microversion: 2.20 time: 0.276833 Jul 02 03:43:51.771752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 454/898] 10.222.0.42 () {60 vars in 1456 bytes} [Sat Jul 2 03:43:51 2022] DELETE /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-volume_attachments/831b15b3-cdf0-43cb-97ea-732858d46d55 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:43:51.830122 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6ca3a1cb-d61a-4a38-a409-f55dd52565dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:43:51.830696 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6ca3a1cb-d61a-4a38-a409-f55dd52565dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:51.837789 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ca3a1cb-d61a-4a38-a409-f55dd52565dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.838236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ca3a1cb-d61a-4a38-a409-f55dd52565dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.838990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ca3a1cb-d61a-4a38-a409-f55dd52565dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.839482 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6ca3a1cb-d61a-4a38-a409-f55dd52565dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.926169 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6ca3a1cb-d61a-4a38-a409-f55dd52565dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "POST /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/action" status: 202 len: 0 microversion: 2.20 time: 0.100028 Jul 02 03:43:51.927441 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 445/899] 10.222.0.42 () {62 vars in 1318 bytes} [Sat Jul 2 03:43:51 2022] POST /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:43:51.936996 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:51.937598 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:51.944837 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.945278 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:51.946039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:51.946485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:52.077950 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:52.086051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:52.087563 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:52.088785 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-aee68085-a1af-48fb-96bc-63e0b095b0f0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1671 microversion: 2.20 time: 0.155762 Jul 02 03:43:52.089357 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 455/900] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:51 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:53.112260 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:53.113160 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:53.124749 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:53.125493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:53.126768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:53.127546 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:53.267941 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:53.276562 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:53.278065 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:53.279237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dd6a0778-89a6-4d65-95fe-5a8c2f843837 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.174377 Jul 02 03:43:53.279834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 446/901] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:53 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:54.298652 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:54.299274 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:54.306528 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:54.307382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:54.308427 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:54.309094 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:54.702450 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:54.711145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:54.712681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:54.713851 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f43647f4-8c01-4bfd-8610-431330c41395 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.419176 Jul 02 03:43:54.714921 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 456/902] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:54 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:55.733129 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:55.733899 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:55.740666 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:55.741208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:55.742035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:55.742753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:55.894504 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:55.903185 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:55.904786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:55.906167 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c09670a4-1918-40a3-945f-c9f39e3ba3d2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.178176 Jul 02 03:43:55.906894 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 447/903] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:55 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:56.925013 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:56.925609 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:56.933285 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:56.933695 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:56.934482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:56.934909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:57.080141 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:57.088694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:57.090621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:57.091888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f8c21bb0-6048-4bbe-a9a9-035ac8cc5109 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.170893 Jul 02 03:43:57.092522 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 457/904] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:56 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:58.110425 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:58.111063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:58.118355 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:58.118815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:58.119626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:58.120062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:58.259028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:58.267692 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:58.269207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:58.270376 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-89d289ca-82f6-4899-a481-b4656ae52597 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.164024 Jul 02 03:43:58.270962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 448/905] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:58 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:43:59.289689 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:43:59.290933 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:43:59.299729 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:59.300172 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:59.301185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:43:59.301610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:43:59.449806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:59.459017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:59.460670 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:43:59.461885 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3892f6d8-723f-4636-9f2d-b3d0b74e388b tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.176553 Jul 02 03:43:59.462440 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 458/906] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:43:59 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:00.480644 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:00.481268 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:00.488397 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:00.488848 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:00.489625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:00.490057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:00.626632 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:00.635497 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:00.637046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:00.638237 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5defdde8-34ae-4f9c-aa57-33be51a2429f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.161751 Jul 02 03:44:00.649054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 449/907] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:00 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:01.659329 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:01.660137 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:01.668939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:01.677494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:01.677494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:01.677494 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:01.862665 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:01.876284 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:01.879883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:01.881642 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a3c5b515-b8b5-47a3-88f0-fdd358cf30ca tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.227785 Jul 02 03:44:01.882373 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 459/908] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:01 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:02.901462 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:02.903536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:02.911361 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:02.911932 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:02.912842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:02.913381 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:03.063329 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:03.072620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:03.074131 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:03.075320 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a7a71ec7-bcd8-4dcb-8951-8f75fcf943c3 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.178233 Jul 02 03:44:03.075890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 450/909] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:02 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:04.098451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:04.099492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:04.107454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:04.107900 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:04.108659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:04.109082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:04.244549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:04.252461 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:04.253953 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:04.255065 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d3710ce0-24a4-4a9a-ab94-7d7829457299 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.163292 Jul 02 03:44:04.255643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 460/910] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:04 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:05.277374 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:05.278412 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:05.289611 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:05.290983 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:05.292164 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:05.292899 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:05.435699 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:05.443812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:05.445301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:05.446476 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cdffb3f7-6713-4465-911e-8356665a751c tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.175899 Jul 02 03:44:05.447365 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 451/911] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:05 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:06.469917 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:06.470981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:06.481017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:06.481462 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:06.482225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:06.482653 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:06.622903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:06.631182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:06.632711 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:06.633887 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b642fb5e-dea0-462b-a627-649e1f0d2c25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.171078 Jul 02 03:44:06.635064 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 461/912] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:06 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:07.656284 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:07.657251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:07.668157 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:07.668601 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:07.669370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:07.669806 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:07.817426 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:07.828151 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:07.829628 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:07.830786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2afbc7e5-e8bf-41f1-a952-b95b227d3e25 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.181457 Jul 02 03:44:07.831357 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 452/913] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:07 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:08.854809 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:08.855570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:08.862655 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:08.863177 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:08.864003 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:08.864437 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:09.001410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:09.009674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:09.011219 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:09.012570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2c8267cb-c765-4e14-8c36-044e4e46b979 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.162047 Jul 02 03:44:09.013147 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 462/914] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:08 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:10.030902 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:10.031526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:10.033938 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=46 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:44:10.039606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:10.040053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:10.040826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:10.041271 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:10.175563 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:10.185253 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:10.187888 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:10.189737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dd9036c5-1b95-4486-8549-4b4b3ffa9104 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.162744 Jul 02 03:44:10.190627 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 453/915] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:10 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:11.001894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-eb3dc1db-650e-49ce-8e31-b94b520658d6 req-c3a06fdb-b417-4c58-b4f2-5267f4753729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86c62ef-7db9-4c66-be31-20868e93d817", "name": "network-vif-plugged", "status": "completed", "tag": "41edcc3a-c954-4e67-a0a2-822da68709b0"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:44:11.012759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-eb3dc1db-650e-49ce-8e31-b94b520658d6 req-c3a06fdb-b417-4c58-b4f2-5267f4753729 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:11.013443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-eb3dc1db-650e-49ce-8e31-b94b520658d6 req-c3a06fdb-b417-4c58-b4f2-5267f4753729 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:11.025179 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-eb3dc1db-650e-49ce-8e31-b94b520658d6 req-c3a06fdb-b417-4c58-b4f2-5267f4753729 service nova] Creating event network-vif-plugged:41edcc3a-c954-4e67-a0a2-822da68709b0 for instance e86c62ef-7db9-4c66-be31-20868e93d817 on hv-cinder-84684 Jul 02 03:44:11.030421 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-eb3dc1db-650e-49ce-8e31-b94b520658d6 req-c3a06fdb-b417-4c58-b4f2-5267f4753729 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032200 Jul 02 03:44:11.031051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 463/916] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:44:11.214575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:11.215245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:11.222097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:11.222547 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:11.223340 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:11.223778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:11.359626 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:11.367946 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:11.369464 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:11.370703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ace3a8b8-ebed-4d53-bac0-9764cd367b63 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.160501 Jul 02 03:44:11.371278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 454/917] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:11 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:12.394790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:12.395852 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:12.398882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=38 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:44:12.405862 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:12.406314 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:12.407090 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:12.407556 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:12.544643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:12.552969 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:12.554463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:12.555652 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-9156fbd8-d7c0-4923-b75e-772cfa1d5b59 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1729 microversion: 2.20 time: 0.168987 Jul 02 03:44:12.556215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 464/918] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:12 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:44:13.574132 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:44:13.574731 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:44:13.581691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:13.582142 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:13.582928 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:44:13.583389 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:44:13.725093 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:13.734062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:13.735600 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:44:13.736769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-df2c5c45-e947-43a3-987b-33f386063047 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1716 microversion: 2.20 time: 0.166792 Jul 02 03:44:13.737336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 455/919] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:44:13 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:45:01.410119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-39c9248b-7d3c-445e-963a-35e0bfb6d84d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:01.410762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-39c9248b-7d3c-445e-963a-35e0bfb6d84d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:01.412951 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:01.413644 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:01.420757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39c9248b-7d3c-445e-963a-35e0bfb6d84d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:01.421421 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39c9248b-7d3c-445e-963a-35e0bfb6d84d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:01.422297 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39c9248b-7d3c-445e-963a-35e0bfb6d84d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:01.422728 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-39c9248b-7d3c-445e-963a-35e0bfb6d84d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:01.448979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-39c9248b-7d3c-445e-963a-35e0bfb6d84d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/ips" status: 200 len: 149 microversion: 2.1 time: 0.043059 Jul 02 03:45:01.449552 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 465/920] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:45:01 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:45:02.808825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b03c760b-7c09-46f0-86b5-5e7b0fc942f3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73f28f6d-567a-4895-b3f9-f5a471107cff"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:45:02.810000 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b03c760b-7c09-46f0-86b5-5e7b0fc942f3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:02.812703 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=5 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:02.813377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:02.820304 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b03c760b-7c09-46f0-86b5-5e7b0fc942f3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:02.820753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b03c760b-7c09-46f0-86b5-5e7b0fc942f3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:02.821549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b03c760b-7c09-46f0-86b5-5e7b0fc942f3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:02.822008 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b03c760b-7c09-46f0-86b5-5e7b0fc942f3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:03.204710 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b03c760b-7c09-46f0-86b5-5e7b0fc942f3 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "POST /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399787 Jul 02 03:45:03.205311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 456/921] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:45:02 2022] POST /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:45:10.886466 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:10.887021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:10.894159 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:10.894603 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:10.895498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:10.895935 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:11.036113 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lazy-loading 'services' on Instance uuid 1af2c7ed-c01c-4f12-a9c9-28129e849bdc {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:45:11.120127 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cbb4df40-4acc-4626-89b4-4c7bb274ca9c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments/73f28f6d-567a-4895-b3f9-f5a471107cff" status: 202 len: 0 microversion: 2.1 time: 0.237418 Jul 02 03:45:11.120718 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 466/922] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:45:10 2022] DELETE /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments/73f28f6d-567a-4895-b3f9-f5a471107cff => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:45:11.130395 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2d2c6de8-3aab-49a8-9732-7126f67ac576 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:11.131734 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2d2c6de8-3aab-49a8-9732-7126f67ac576 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:11.138792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d2c6de8-3aab-49a8-9732-7126f67ac576 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:11.139244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d2c6de8-3aab-49a8-9732-7126f67ac576 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:11.140058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d2c6de8-3aab-49a8-9732-7126f67ac576 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:11.140490 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2d2c6de8-3aab-49a8-9732-7126f67ac576 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:11.174598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2d2c6de8-3aab-49a8-9732-7126f67ac576 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049072 Jul 02 03:45:11.175261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 457/923] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:45:11 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:45:12.194610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fb9e4e09-47e2-4eb2-b8fc-7b279f4cdbd4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:12.197588 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fb9e4e09-47e2-4eb2-b8fc-7b279f4cdbd4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:12.208348 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb9e4e09-47e2-4eb2-b8fc-7b279f4cdbd4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:12.208811 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb9e4e09-47e2-4eb2-b8fc-7b279f4cdbd4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:12.209573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb9e4e09-47e2-4eb2-b8fc-7b279f4cdbd4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:12.209998 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb9e4e09-47e2-4eb2-b8fc-7b279f4cdbd4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:12.239144 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fb9e4e09-47e2-4eb2-b8fc-7b279f4cdbd4 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054292 Jul 02 03:45:12.239727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 467/924] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:45:12 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:45:12.304194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:12.304730 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:12.314716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:12.315633 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:12.316230 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:12.316707 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:12.341964 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:45:12.423800 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-461c7968-bc18-4cbf-988d-b8b33583fbf0 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 204 len: 0 microversion: 2.1 time: 0.125418 Jul 02 03:45:12.424421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 458/925] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:45:12 2022] DELETE /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:45:12.433006 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:12.433624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:12.439882 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:12.440343 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:12.441343 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:12.441780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:12.583324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:12.591723 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e8879411-b95d-4341-898e-1d6bf376e2e9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1678 microversion: 2.1 time: 0.162577 Jul 02 03:45:12.592366 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 468/926] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:12 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:13.611321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:13.612058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:13.619028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:13.619500 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:13.620262 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:13.620691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:13.754540 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:13.762276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-65b52628-df6b-4bda-99e7-b3b3ec964d34 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1678 microversion: 2.1 time: 0.155216 Jul 02 03:45:13.762806 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 459/927] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:13 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:14.779806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:14.780396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:14.788196 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:14.788650 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:14.789425 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:14.789866 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:14.927664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '868e2f0e822b430981369d414eee8e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44eff44cb504e1f9bf037303db24d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:14.935346 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f3a25408-d1fc-41e3-8369-5db3b669b72f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 200 len: 1678 microversion: 2.1 time: 0.159467 Jul 02 03:45:14.935910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 469/928] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:14 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:15.383936 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-52c102ea-0531-49ae-8288-a56ab3406eb6 req-623790e4-e437-49f0-bd89-8267ad196f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af2c7ed-c01c-4f12-a9c9-28129e849bdc", "name": "network-vif-deleted", "tag": "69d4d9fb-1309-4a88-8717-b17ebe2b00bd"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:45:15.392776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-52c102ea-0531-49ae-8288-a56ab3406eb6 req-623790e4-e437-49f0-bd89-8267ad196f29 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:15.393278 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-52c102ea-0531-49ae-8288-a56ab3406eb6 req-623790e4-e437-49f0-bd89-8267ad196f29 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:15.405137 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-52c102ea-0531-49ae-8288-a56ab3406eb6 req-623790e4-e437-49f0-bd89-8267ad196f29 service nova] Creating event network-vif-deleted:69d4d9fb-1309-4a88-8717-b17ebe2b00bd for instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc on hv-cinder-84684 Jul 02 03:45:15.410000 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-52c102ea-0531-49ae-8288-a56ab3406eb6 req-623790e4-e437-49f0-bd89-8267ad196f29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029695 Jul 02 03:45:15.410961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 460/929] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:45:15.952599 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:15.953261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:15.959888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:15.960588 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:15.961465 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:15.961894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:15.975784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc HTTP/1.1 Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:45:15.977442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:15.979182 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '1af2c7ed-c01c-4f12-a9c9-28129e849bdc'} Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:15.983575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:15.985117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:15.986530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:15.986530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a4232f95-85c9-4bb5-9a4f-bcad85944aa9 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 404 len: 111 microversion: 2.1 time: 0.030297 Jul 02 03:45:15.986530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 470/930] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:15 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:15.988452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2de3d928-1def-45c6-8c16-44aa13744bde tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '.version_select at 0x7f2e974ce550>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:16.007139 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2de3d928-1def-45c6-8c16-44aa13744bde tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391208223" status: 202 len: 0 microversion: 2.1 time: 0.022904 Jul 02 03:45:16.008047 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 461/931] 10.222.0.42 () {58 vars in 1217 bytes} [Sat Jul 2 03:45:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391208223 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:45:17.826004 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:17.826525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:17.833257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:17.833792 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:17.834450 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:17.834878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:17.848896 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc HTTP/1.1 Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:45:17.850451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.851920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '1af2c7ed-c01c-4f12-a9c9-28129e849bdc'} Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:17.852810 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.854212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.855708 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:17.855708 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e0ef8678-fb51-41b2-a510-a971dde2867c tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 404 len: 111 microversion: 2.1 time: 0.029762 Jul 02 03:45:17.855708 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 471/932] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:45:17 2022] DELETE /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:17.860952 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:17.861687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 1af2c7ed-c01c-4f12-a9c9-28129e849bdc] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:17.868173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:17.868622 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:17.869382 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:17.869813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:17.882803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc HTTP/1.1 Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:45:17.884430 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.886016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '1af2c7ed-c01c-4f12-a9c9-28129e849bdc'} Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:17.887002 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. Jul 02 03:45:17.888263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:17.889464 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 1af2c7ed-c01c-4f12-a9c9-28129e849bdc could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:17.889464 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6161758d-d2d1-471d-a450-ef31bb4d70e7 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc" status: 404 len: 111 microversion: 2.1 time: 0.029289 Jul 02 03:45:17.889464 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 462/933] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:17 2022] GET /compute/v2.1/servers/1af2c7ed-c01c-4f12-a9c9-28129e849bdc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:19.034290 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:19.034980 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:19.042184 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.042626 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.043471 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.043876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.058170 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af HTTP/1.1 Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:45:19.059870 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.061485 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '6ff687e9-ce72-49c7-bb72-f563c433f7af'} Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:19.062411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.063888 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.065355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:19.065355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-bdadc5e0-da34-4f60-b953-a2a91ff73b1e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 404 len: 111 microversion: 2.1 time: 0.031320 Jul 02 03:45:19.065355 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 472/934] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:45:19 2022] DELETE /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:19.070862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:19.071525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 6ff687e9-ce72-49c7-bb72-f563c433f7af] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:19.078542 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.078995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.079805 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.080243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.096817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af HTTP/1.1 Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:45:19.099046 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.100575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '6ff687e9-ce72-49c7-bb72-f563c433f7af'} Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:19.101612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. Jul 02 03:45:19.103836 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.105614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 6ff687e9-ce72-49c7-bb72-f563c433f7af could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:19.105614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-babe5c6b-5d0c-4700-82bf-548cf8fd9145 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af" status: 404 len: 111 microversion: 2.1 time: 0.033968 Jul 02 03:45:19.105614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 463/935] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:19 2022] GET /compute/v2.1/servers/6ff687e9-ce72-49c7-bb72-f563c433f7af => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:19.113024 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:19.113622 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:19.124122 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.124765 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.125981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.126710 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.144253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 HTTP/1.1 Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:45:19.145782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.147135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '671321a8-96a7-4fc0-96b1-0fd9b12dc028'} Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:19.148692 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.150023 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.151262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:19.151262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a321a15d-223f-4644-94fb-9add2f26351d tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 404 len: 111 microversion: 2.1 time: 0.040413 Jul 02 03:45:19.151262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 473/936] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:45:19 2022] DELETE /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 03:45:19.155923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:19.156532 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: 671321a8-96a7-4fc0-96b1-0fd9b12dc028] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:19.163138 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.163656 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.164417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:19.164803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:19.179697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 HTTP/1.1 Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:45:19.181221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.182781 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '671321a8-96a7-4fc0-96b1-0fd9b12dc028'} Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:19.183709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. Jul 02 03:45:19.185252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:19.186541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance 671321a8-96a7-4fc0-96b1-0fd9b12dc028 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:19.186541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e3ffb8ba-b8ac-4300-812e-a44d147b675f tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028" status: 404 len: 111 microversion: 2.1 time: 0.030510 Jul 02 03:45:19.186541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 464/937] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:19 2022] GET /compute/v2.1/servers/671321a8-96a7-4fc0-96b1-0fd9b12dc028 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:20.321402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:20.321932 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:20.328754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.329189 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.329954 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.330381 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.343927 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 HTTP/1.1 Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:45:20.345443 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.346854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'e880e075-40f8-4727-b142-83ae3e2c6d03'} Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:20.347812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.349157 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.350784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:20.350784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-8de6e567-70cc-4b17-8b9e-91daecb39d68 tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 404 len: 111 microversion: 2.1 time: 0.031951 Jul 02 03:45:20.350784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 474/938] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:45:20 2022] DELETE /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:20.355568 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:20.356226 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] [instance: e880e075-40f8-4727-b142-83ae3e2c6d03] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:20.363028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.363510 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.364270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.364766 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.378793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] HTTP exception thrown: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Request method failure captured: Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 HTTP/1.1 Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zDBnNNJB3ADJwzn6n6g0gxyfEi-PYwx-2f95EVC65BWDsuJJN9pnoAGb4J5pDxZ4OuEFJls05FpHbhASaAOkILBoCriCLHOCN4x3iCoJVA4GrS40nitt1VxDXJ1le5zmywbBFK3caAeC6tzkDuENjDCXFbB-caIQL4arce9Yy-XSw Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:45:20.380439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b44eff44cb504e1f9bf037303db24d1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b44eff44cb504e1f9bf037303db24d1b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: b44eff44cb504e1f9bf037303db24d1b Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1578252906 Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 868e2f0e822b430981369d414eee8e53 Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeNegativeTest-1578252906-project Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.381862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'e880e075-40f8-4727-b142-83ae3e2c6d03'} Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:20.382604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. Jul 02 03:45:20.383853 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:20.384947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] Returning 404 to user: Instance e880e075-40f8-4727-b142-83ae3e2c6d03 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:20.384947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2b8eb50e-e747-41e1-a255-b12a9b7fb69e tempest-AttachVolumeNegativeTest-1578252906 tempest-AttachVolumeNegativeTest-1578252906-project] 10.222.0.42 "GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03" status: 404 len: 111 microversion: 2.1 time: 0.030153 Jul 02 03:45:20.384947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 465/939] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:20 2022] GET /compute/v2.1/servers/e880e075-40f8-4727-b142-83ae3e2c6d03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:45:20.800452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-22be063a-cde9-4216-8951-221f5b69c95d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:20.801511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-22be063a-cde9-4216-8951-221f5b69c95d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:20.807759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22be063a-cde9-4216-8951-221f5b69c95d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.808214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22be063a-cde9-4216-8951-221f5b69c95d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.808985 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22be063a-cde9-4216-8951-221f5b69c95d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.809422 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-22be063a-cde9-4216-8951-221f5b69c95d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.839211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-22be063a-cde9-4216-8951-221f5b69c95d tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042805 Jul 02 03:45:20.839808 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 475/940] 10.222.0.42 () {60 vars in 1342 bytes} [Sat Jul 2 03:45:20 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:20.898661 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:20.899254 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:20.905311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.905763 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.906528 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:20.906968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:20.932983 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:45:21.009884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-646f7b3a-6037-4681-92a0-e358889dbe80 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 204 len: 0 microversion: 2.20 time: 0.115417 Jul 02 03:45:21.010470 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 466/941] 10.222.0.42 () {60 vars in 1279 bytes} [Sat Jul 2 03:45:20 2022] DELETE /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 03:45:21.021889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:21.022492 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:21.028695 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:21.029153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:21.029915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:21.030347 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:21.176028 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:21.184487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:21.185981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:21.187337 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e3e6b88f-5ae8-4f77-8240-3f240d3d4b9a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.171188 Jul 02 03:45:21.187902 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 476/942] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:45:21 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:45:22.206947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:22.207864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:22.214539 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:22.215252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:22.216325 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:22.216994 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:22.354484 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:22.363183 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:22.365345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:22.366652 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-341e78ea-605b-40fa-b949-a3b478db44dc tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.164095 Jul 02 03:45:22.367765 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 467/943] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:45:22 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:45:23.385705 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:23.386265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:23.393257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:23.393743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:23.394641 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:23.395119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:23.567214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:23.579111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:23.580777 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:23.583396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6b325bee-9591-4c44-b9c1-cb2149b2749a tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1722 microversion: 2.20 time: 0.201787 Jul 02 03:45:23.584610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 477/944] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:45:23 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:45:24.391091 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-68f3877f-217e-49da-915f-1590d7803c98 req-2fa0ee6b-d77c-4ae6-9cac-dfa70d485d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86c62ef-7db9-4c66-be31-20868e93d817", "name": "network-vif-deleted", "tag": "41edcc3a-c954-4e67-a0a2-822da68709b0"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:45:24.401489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-68f3877f-217e-49da-915f-1590d7803c98 req-2fa0ee6b-d77c-4ae6-9cac-dfa70d485d58 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:24.401938 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-68f3877f-217e-49da-915f-1590d7803c98 req-2fa0ee6b-d77c-4ae6-9cac-dfa70d485d58 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:24.417035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-68f3877f-217e-49da-915f-1590d7803c98 req-2fa0ee6b-d77c-4ae6-9cac-dfa70d485d58 service nova] Creating event network-vif-deleted:41edcc3a-c954-4e67-a0a2-822da68709b0 for instance e86c62ef-7db9-4c66-be31-20868e93d817 on hv-cinder-84684 Jul 02 03:45:24.422713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-68f3877f-217e-49da-915f-1590d7803c98 req-2fa0ee6b-d77c-4ae6-9cac-dfa70d485d58 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042091 Jul 02 03:45:24.424114 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 468/945] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:45:24.603827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:24.605009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:24.612590 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:24.613233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:24.614018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:24.614520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:24.648716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:24.649240 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:24.649912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lazy-loading 'fault' on Instance uuid e86c62ef-7db9-4c66-be31-20868e93d817 {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:45:24.701158 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:24.709680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:24.711348 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '112d731047a64efc8e9143c4d471a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f39e852f8d14dec8e98d8d77fe90766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:24.712630 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-426762dc-32b5-4b22-8850-665ab8159512 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 200 len: 1370 microversion: 2.20 time: 0.112713 Jul 02 03:45:24.713265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 478/946] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:45:24 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 03:45:25.732054 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:25.732913 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:25.740415 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:25.740948 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:25.741794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:25.742299 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:25.758215 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] HTTP exception thrown: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Request method failure captured: Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 HTTP/1.1 Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zEyupuBKtztOeuitxYz5ELc7XeKAPMt1DVpam-2xKCvocm-vlbWmWttSZv2VCazCBDcOAglicsgin78b2IjLYoRijCMnvj5qKUN4JbsWG16AgiCxCV51qJwHxxoh5ibg3B6OYc1tX6V4S-sfDsq86_bkotMeHLHSao7UtTau2r-3M Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:45:25.760269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7f39e852f8d14dec8e98d8d77fe90766", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 112d731047a64efc8e9143c4d471a7d6 Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:25.761954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'e86c62ef-7db9-4c66-be31-20868e93d817'} Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:25.762875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:25.764369 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:25.766494 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Returning 404 to user: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:25.767504 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cc7f8eb8-db81-4116-90b9-92c9d4a98eb2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 404 len: 111 microversion: 2.20 time: 0.040056 Jul 02 03:45:25.768545 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 469/947] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:45:25 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:45:25.777565 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-dfa386fc-d4e7-4681-b489-fb26ea8fafc0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '.version_select at 0x7f2e97606f70>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:25.804411 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-dfa386fc-d4e7-4681-b489-fb26ea8fafc0 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234293212" status: 204 len: 0 microversion: 2.20 time: 0.030680 Jul 02 03:45:25.805524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 479/948] 10.222.0.42 () {60 vars in 1258 bytes} [Sat Jul 2 03:45:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234293212 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 03:45:27.585343 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:27.585846 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:27.592952 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:27.593402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:27.594176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:27.594610 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:27.608796 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] HTTP exception thrown: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Request method failure captured: Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: DELETE /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 HTTP/1.1 Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zEyupuBKtztOeuitxYz5ELc7XeKAPMt1DVpam-2xKCvocm-vlbWmWttSZv2VCazCBDcOAglicsgin78b2IjLYoRijCMnvj5qKUN4JbsWG16AgiCxCV51qJwHxxoh5ibg3B6OYc1tX6V4S-sfDsq86_bkotMeHLHSao7UtTau2r-3M Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:45:27.610338 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7f39e852f8d14dec8e98d8d77fe90766", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 112d731047a64efc8e9143c4d471a7d6 Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.611912 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'e86c62ef-7db9-4c66-be31-20868e93d817'} Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:27.612859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.614270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.615709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Returning 404 to user: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:27.615709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-db60f313-7ba9-4b00-a92a-459734d694b2 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 404 len: 111 microversion: 2.20 time: 0.030316 Jul 02 03:45:27.615709 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 470/949] 10.222.0.42 () {60 vars in 1279 bytes} [Sat Jul 2 03:45:27 2022] DELETE /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:45:27.621026 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:27.621629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: e86c62ef-7db9-4c66-be31-20868e93d817] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:27.628874 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:27.629337 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:27.630220 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:27.630658 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:27.644321 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] HTTP exception thrown: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Request method failure captured: Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 HTTP/1.1 Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zEyupuBKtztOeuitxYz5ELc7XeKAPMt1DVpam-2xKCvocm-vlbWmWttSZv2VCazCBDcOAglicsgin78b2IjLYoRijCMnvj5qKUN4JbsWG16AgiCxCV51qJwHxxoh5ibg3B6OYc1tX6V4S-sfDsq86_bkotMeHLHSao7UtTau2r-3M Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:45:27.645879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7f39e852f8d14dec8e98d8d77fe90766", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 112d731047a64efc8e9143c4d471a7d6 Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.647500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'e86c62ef-7db9-4c66-be31-20868e93d817'} Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:27.648293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. Jul 02 03:45:27.649508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:27.650625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Returning 404 to user: Instance e86c62ef-7db9-4c66-be31-20868e93d817 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:27.650625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-484f64b7-4238-48d2-8fb0-bbf9fe94e67f tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817" status: 404 len: 111 microversion: 2.20 time: 0.030640 Jul 02 03:45:27.650625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 480/950] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:45:27 2022] GET /compute/v2.1/servers/e86c62ef-7db9-4c66-be31-20868e93d817 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:45:28.800869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:28.801405 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:28.808672 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:28.809124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:28.809905 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:28.810339 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:28.824276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] HTTP exception thrown: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Request method failure captured: Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: DELETE /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 HTTP/1.1 Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv7zEyupuBKtztOeuitxYz5ELc7XeKAPMt1DVpam-2xKCvocm-vlbWmWttSZv2VCazCBDcOAglicsgin78b2IjLYoRijCMnvj5qKUN4JbsWG16AgiCxCV51qJwHxxoh5ibg3B6OYc1tX6V4S-sfDsq86_bkotMeHLHSao7UtTau2r-3M Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:45:28.825843 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7f39e852f8d14dec8e98d8d77fe90766", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: 112d731047a64efc8e9143c4d471a7d6 Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.827480 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'bd2d5a1f-4e5b-4072-851a-d01f23742f55'} Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:28.828597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.830143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.831934 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Returning 404 to user: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:28.831934 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-293ff7c0-586b-4d91-8873-18dfa7496fb1 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 404 len: 111 microversion: 2.20 time: 0.030516 Jul 02 03:45:28.831934 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 471/951] 10.222.0.42 () {60 vars in 1279 bytes} [Sat Jul 2 03:45:28 2022] DELETE /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:45:28.836012 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:28.836625 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] [instance: bd2d5a1f-4e5b-4072-851a-d01f23742f55] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:28.843429 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:28.843886 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:28.844646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:28.845080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:28.858659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] HTTP exception thrown: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Request method failure captured: Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 HTTP/1.1 Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv7zEyupuBKtztOeuitxYz5ELc7XeKAPMt1DVpam-2xKCvocm-vlbWmWttSZv2VCazCBDcOAglicsgin78b2IjLYoRijCMnvj5qKUN4JbsWG16AgiCxCV51qJwHxxoh5ibg3B6OYc1tX6V4S-sfDsq86_bkotMeHLHSao7UtTau2r-3M Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:45:28.860515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7f39e852f8d14dec8e98d8d77fe90766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7f39e852f8d14dec8e98d8d77fe90766", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 7f39e852f8d14dec8e98d8d77fe90766 Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1497929565 Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: 112d731047a64efc8e9143c4d471a7d6 Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1497929565-project Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.862518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'bd2d5a1f-4e5b-4072-851a-d01f23742f55'} Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:45:28.863677 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. Jul 02 03:45:28.865795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:45:28.867456 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] Returning 404 to user: Instance bd2d5a1f-4e5b-4072-851a-d01f23742f55 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:45:28.867456 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ba384f76-49fa-4218-8459-42811cca6238 tempest-AttachVolumeShelveTestJSON-1497929565 tempest-AttachVolumeShelveTestJSON-1497929565-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55" status: 404 len: 111 microversion: 2.20 time: 0.029871 Jul 02 03:45:28.867456 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 481/952] 10.222.0.42 () {60 vars in 1276 bytes} [Sat Jul 2 03:45:28 2022] GET /compute/v2.1/servers/bd2d5a1f-4e5b-4072-851a-d01f23742f55 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 03:45:37.803150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1e04566a-81b6-41d9-aa94-f520888ee81c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'create', calling method: .version_select at 0x7f2e974ceca0>, body: {"keypair": {"name": "tempest-keypair-798240496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5jtFOoNTbI49kGALZ/ClpaqqY4y9IPrXziz8RixlzbDhyNCMmqSeCnBCq3KIHdxRp1kcHL1IVNTF+4/BHf/1CG78mhSdk2/l8D9KjUhzzqktiw8/+GvPKQ15tDZxzMag=="}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:45:37.807285 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:37.820318 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-1e04566a-81b6-41d9-aa94-f520888ee81c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for project 0665267ba574490cbcf958be4d793dd3. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:45:37.824865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-1e04566a-81b6-41d9-aa94-f520888ee81c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for user e80e09005b7e4cdc8f42be866dbd91bb and project 0665267ba574490cbcf958be4d793dd3. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:45:37.851689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1e04566a-81b6-41d9-aa94-f520888ee81c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171684 Jul 02 03:45:37.852304 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 472/953] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:45:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:45:39.234783 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1738224293", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2526fc80-7281-4aad-9a6a-6587590ab6d6"}], "security_groups": [{"name": "tempest-securitygroup--358258219"}], "key_name": "tempest-keypair-798240496", "user_data": "}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:45:39.242133 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:39.242788 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:39.349390 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] validate_networks() for [('2526fc80-7281-4aad-9a6a-6587590ab6d6', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:45:39.740542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:45:39.740964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:45:39.741459 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:45:39.741862 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:45:39.742300 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:45:39.751233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:39.751713 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:39.752511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:39.752943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:39.770088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for project 0665267ba574490cbcf958be4d793dd3. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:45:39.774155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for user e80e09005b7e4cdc8f42be866dbd91bb and project 0665267ba574490cbcf958be4d793dd3. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:45:39.785795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:45:39.788127 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:45:39.836696 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [2a66627c-3bfa-489c-aa89-5db3d41631bd] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 03:45:40.845546 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [2a66627c-3bfa-489c-aa89-5db3d41631bd] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39504. Jul 02 03:45:40.850289 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7bca22dc-9de2-4768-a1b0-87d5ef9ab009 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.619604 Jul 02 03:45:40.851195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 482/954] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:45:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:45:40.861552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7bf6a4d9-b905-4a27-ba34-9144cc6af8d7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:40.862448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7bf6a4d9-b905-4a27-ba34-9144cc6af8d7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:40.866737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:40.927407 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7bf6a4d9-b905-4a27-ba34-9144cc6af8d7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:40.938531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7bf6a4d9-b905-4a27-ba34-9144cc6af8d7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1237 microversion: 2.1 time: 0.080803 Jul 02 03:45:40.939351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 473/955] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:40 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:41.960570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:41.961117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:41.969565 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:41.970011 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:41.970768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:41.971201 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:42.040243 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:42.048438 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e73f1e8f-eea6-4bbf-84a7-637fd048e489 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1241 microversion: 2.1 time: 0.095436 Jul 02 03:45:42.048998 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 483/956] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:41 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:43.065833 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:43.066421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:43.073570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:43.074025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:43.074798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:43.075234 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:43.137737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:43.145372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6016a93b-407e-4cc1-869f-0dfb6579b943 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1233 microversion: 2.1 time: 0.083492 Jul 02 03:45:43.145960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 474/957] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:43 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:44.168098 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:44.168696 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:44.177017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:44.178097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:44.179068 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:44.179558 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:44.246897 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:44.254941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5b84c9ce-3e1c-4ca0-a368-74beb3184330 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1289 microversion: 2.1 time: 0.091397 Jul 02 03:45:44.255570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 484/958] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:44 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:45.272207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:45.272908 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:45.279963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:45.280321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:45.281172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:45.281606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:45.343818 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:45.353175 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d2dd374c-af5d-40c6-baca-ec48abd1526a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1295 microversion: 2.1 time: 0.084857 Jul 02 03:45:45.362720 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 475/959] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:45 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:46.303890 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-7715e188-b63f-4603-8158-e6d80f94d1d3 req-246bb182-d344-417f-8cd0-3f8a45fd7f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f0da2c-7771-4e9c-9dfd-e5a12e452bba", "tag": "9dc25d19-95aa-4170-9015-29cd666dc12e"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:45:46.312679 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-7715e188-b63f-4603-8158-e6d80f94d1d3 req-246bb182-d344-417f-8cd0-3f8a45fd7f60 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:46.313112 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-7715e188-b63f-4603-8158-e6d80f94d1d3 req-246bb182-d344-417f-8cd0-3f8a45fd7f60 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:46.324570 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-7715e188-b63f-4603-8158-e6d80f94d1d3 req-246bb182-d344-417f-8cd0-3f8a45fd7f60 service nova] Creating event network-changed:9dc25d19-95aa-4170-9015-29cd666dc12e for instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba on hv-cinder-84684 Jul 02 03:45:46.329779 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-7715e188-b63f-4603-8158-e6d80f94d1d3 req-246bb182-d344-417f-8cd0-3f8a45fd7f60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105230 Jul 02 03:45:46.330377 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 485/960] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:45:46.370389 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:46.371356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:46.378394 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:46.378962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:46.380056 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:46.380641 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:46.513217 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:46.522847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1e185966-6660-4713-a3a7-0883dc29dddd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.155755 Jul 02 03:45:46.523481 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 476/961] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:46 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:47.544518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:47.544518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:47.551732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:47.552173 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:47.552939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:47.553476 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:47.694212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:47.702334 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1d348a0d-6f46-42ca-a9f0-0e6d6228a74b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.165469 Jul 02 03:45:47.702909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 486/962] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:47 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:48.723981 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:48.725264 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:48.736433 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:48.737189 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:48.738447 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:48.739172 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:48.874128 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:48.882207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c3971447-b6a5-4801-b025-a0a665b93cf3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.164952 Jul 02 03:45:48.882742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 477/963] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:48 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:49.902040 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:49.902701 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:49.904951 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:49.905608 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=6 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:49.913454 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:49.913910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:49.914688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:49.915123 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:50.063623 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:50.074924 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4d3ee477-1c8e-4977-b7b5-ab3eaca7863d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.176574 Jul 02 03:45:50.075904 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 487/964] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:49 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:51.098923 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:51.100387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:51.104000 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:51.113232 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:51.113990 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:51.115261 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:51.115751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:51.253305 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:51.261541 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0f156393-8c0b-4ee9-9508-627ffa382a9b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.169103 Jul 02 03:45:51.262087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 478/965] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:51 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:52.279491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:52.280069 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:52.287048 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:52.287532 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:52.288445 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:52.288906 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:52.426345 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:52.434690 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b3d9f472-80d8-4d28-84d9-ed6296c89577 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.158995 Jul 02 03:45:52.435187 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 488/966] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:52 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:53.451951 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:53.452544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:53.459548 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:53.459995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:53.460837 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:53.461281 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:53.607960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:53.615653 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c765321a-2839-4c1a-a290-d95fabccea6d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.167706 Jul 02 03:45:53.616321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 479/967] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:53 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:54.637718 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:54.638726 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:54.651489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:54.651869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:54.652643 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:54.653079 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:54.800038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:54.807986 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a30f97a4-1000-469c-a9d9-66c5e249494c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.176859 Jul 02 03:45:54.808540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 489/968] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:54 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:55.826962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:55.827859 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:55.836352 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:55.836954 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:55.837970 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:55.838565 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:55.979426 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:55.987093 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f79c4e73-b08b-4fcf-b5ea-0e802e21c80e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.165407 Jul 02 03:45:55.987715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 480/969] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:55 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:57.008301 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:57.009493 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:57.021091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:57.021894 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:57.023189 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:57.024232 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:57.173502 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:57.181055 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-12987b2a-1319-4560-a927-188d3f2d15d2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.179649 Jul 02 03:45:57.181613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 490/970] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:56 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:58.198766 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:58.199421 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:58.206593 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:58.207055 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:58.207837 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:58.208280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:58.363500 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:58.372003 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0a5309dd-8bca-4df3-9750-adb15c96588f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.177424 Jul 02 03:45:58.372505 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 481/971] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:58 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:45:59.388504 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:45:59.389258 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:45:59.398500 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:59.398952 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:59.399751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:59.400284 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:59.508579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-3c81da78-1f8a-4c9f-8990-6e31fbac529c req-7f9353ea-da40-40f3-ac0b-675057ceaa0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f0da2c-7771-4e9c-9dfd-e5a12e452bba", "name": "network-vif-plugged", "status": "completed", "tag": "9dc25d19-95aa-4170-9015-29cd666dc12e"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:45:59.524313 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-3c81da78-1f8a-4c9f-8990-6e31fbac529c req-7f9353ea-da40-40f3-ac0b-675057ceaa0d service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:45:59.525072 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-3c81da78-1f8a-4c9f-8990-6e31fbac529c req-7f9353ea-da40-40f3-ac0b-675057ceaa0d service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:45:59.537025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-3c81da78-1f8a-4c9f-8990-6e31fbac529c req-7f9353ea-da40-40f3-ac0b-675057ceaa0d service nova] Creating event network-vif-plugged:9dc25d19-95aa-4170-9015-29cd666dc12e for instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba on hv-cinder-84684 Jul 02 03:45:59.541287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:45:59.543047 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-3c81da78-1f8a-4c9f-8990-6e31fbac529c req-7f9353ea-da40-40f3-ac0b-675057ceaa0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100854 Jul 02 03:45:59.543870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 482/972] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:45:59.549579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1164659b-69cd-4d08-b8e7-8d5119f93366 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.165212 Jul 02 03:45:59.550141 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 491/973] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:45:59 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:00.567933 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:00.568614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:00.576090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:00.576536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:00.577309 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:00.577722 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:00.711734 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:00.723259 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a23f8515-c10b-4cce-80af-e7d76a6f62c5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.159372 Jul 02 03:46:00.724057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 483/974] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:00 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:46:01.741438 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:01.742083 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:01.750213 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:01.750917 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:01.752471 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:01.753517 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:01.929863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:01.938282 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-82162a38-c781-4b43-884c-43f8df9546fe tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1362 microversion: 2.1 time: 0.201077 Jul 02 03:46:01.938932 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 492/975] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:01 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:02.955526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:02.956114 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:02.962972 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:02.963578 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:02.964244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:02.964664 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:03.104043 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:03.112193 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2737bf70-6770-4b05-93b2-77d903d21121 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1547 microversion: 2.1 time: 0.160400 Jul 02 03:46:03.115506 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 484/976] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:02 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:03.128264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7c8bbaa2-7aab-4048-be5c-afffef0f1409 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:03.128833 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7c8bbaa2-7aab-4048-be5c-afffef0f1409 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:03.135505 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c8bbaa2-7aab-4048-be5c-afffef0f1409 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:03.136081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c8bbaa2-7aab-4048-be5c-afffef0f1409 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:03.136862 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c8bbaa2-7aab-4048-be5c-afffef0f1409 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:03.137363 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7c8bbaa2-7aab-4048-be5c-afffef0f1409 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:03.220487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7c8bbaa2-7aab-4048-be5c-afffef0f1409 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096163 Jul 02 03:46:03.221106 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 493/977] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:46:03 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:46:04.173109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-178a3a53-d42e-4b67-93c9-9af0b4248317 req-47907455-4729-4cc5-9d21-97d5b3c0a3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f0da2c-7771-4e9c-9dfd-e5a12e452bba", "tag": "9dc25d19-95aa-4170-9015-29cd666dc12e"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:46:04.182777 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-178a3a53-d42e-4b67-93c9-9af0b4248317 req-47907455-4729-4cc5-9d21-97d5b3c0a3d4 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:04.183220 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-178a3a53-d42e-4b67-93c9-9af0b4248317 req-47907455-4729-4cc5-9d21-97d5b3c0a3d4 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:04.196758 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-178a3a53-d42e-4b67-93c9-9af0b4248317 req-47907455-4729-4cc5-9d21-97d5b3c0a3d4 service nova] Creating event network-changed:9dc25d19-95aa-4170-9015-29cd666dc12e for instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba on hv-cinder-84684 Jul 02 03:46:04.201862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-178a3a53-d42e-4b67-93c9-9af0b4248317 req-47907455-4729-4cc5-9d21-97d5b3c0a3d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033216 Jul 02 03:46:04.202401 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 485/978] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:46:18.544063 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:46:18.544813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=62 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:46:18.549241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:18.549733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:18.562464 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:18.562920 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:18.563755 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:18.564190 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:18.592467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:46:18.672068 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-87ebcce3-9a54-4cf1-ad45-59d83fe059d8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 204 len: 0 microversion: 2.1 time: 0.129589 Jul 02 03:46:18.672791 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 494/979] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:46:18 2022] DELETE /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:46:18.679013 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:46:18.679800 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=64 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:46:18.684159 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:18.684861 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:18.692623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:18.693081 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:18.693841 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:18.694282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:18.831629 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:18.839649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0b15e78e-9cdf-4af3-975b-2ffb76b1f5ba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1576 microversion: 2.1 time: 0.162267 Jul 02 03:46:18.840220 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 486/980] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:18 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:46:19.863898 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:19.864550 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:19.871082 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:19.871717 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:19.872612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:19.873178 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:20.014058 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:20.021886 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6f7a0103-836d-4a10-a69c-975a665548a8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1576 microversion: 2.1 time: 0.162869 Jul 02 03:46:20.022664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 495/981] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:19 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:21.044768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:21.044768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:21.048937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:21.050053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:21.051034 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:21.052416 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:21.211211 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:21.219815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0492e875-0fb1-443c-a7cb-172bc7467318 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1576 microversion: 2.1 time: 0.183531 Jul 02 03:46:21.220494 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 487/982] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:21 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:21.485928 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-1b4e2156-1690-4a00-8fc4-0ad7b4e8058a req-61f2fa3a-a0ff-461b-8b57-c8b6b1d7d8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0acb8d-32fc-45d8-92c5-50acf318209b", "name": "network-vif-deleted", "tag": "aec144f9-1629-4a8c-81b5-4db1c91d876d"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:46:21.489848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-1b4e2156-1690-4a00-8fc4-0ad7b4e8058a req-61f2fa3a-a0ff-461b-8b57-c8b6b1d7d8bd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:21.489848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-1b4e2156-1690-4a00-8fc4-0ad7b4e8058a req-61f2fa3a-a0ff-461b-8b57-c8b6b1d7d8bd service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:21.500124 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-1b4e2156-1690-4a00-8fc4-0ad7b4e8058a req-61f2fa3a-a0ff-461b-8b57-c8b6b1d7d8bd service nova] Creating event network-vif-deleted:aec144f9-1629-4a8c-81b5-4db1c91d876d for instance ea0acb8d-32fc-45d8-92c5-50acf318209b on hv-cinder-84684 Jul 02 03:46:21.505589 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-1b4e2156-1690-4a00-8fc4-0ad7b4e8058a req-61f2fa3a-a0ff-461b-8b57-c8b6b1d7d8bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034758 Jul 02 03:46:21.509392 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 496/983] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:46:22.237769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:22.238995 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:22.246590 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:22.247037 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:22.248507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:22.248925 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:22.318348 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:22.327452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-db965bbd-a16f-4999-a759-8feb4020ccb0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 200 len: 1225 microversion: 2.1 time: 0.093564 Jul 02 03:46:22.328085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 488/984] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:22 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:23.347381 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:23.348076 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:23.354552 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:23.355000 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:23.355823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:23.356256 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:23.369805 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] HTTP exception thrown: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Request method failure captured: Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b HTTP/1.1 Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv77CUrRmfK1tR1dnKBeNQKCoYBSSnbJtBrbwHF5ec1FDuxkUe-yHxoLR0jU50oLefgl9wZv3a6_5_Ln1wzbJi2VPRzJruKwqKlKGm2byxC89RD-DkAuI9NIWTBPbBLAhQWo8owbEIhPhdXgSyLukeX-bBRkpCAGDy85GNeFu6T4uC_c Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:46:23.371470 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_01fccbd11a4b4e859bec1a56f42315b2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: d42b42214d0d46bbb9fe90aed7f5e382 Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:46:23.373209 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'ea0acb8d-32fc-45d8-92c5-50acf318209b'} Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:46:23.374402 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:46:23.376009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:46:23.377428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Returning 404 to user: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:46:23.377428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fbcc91ed-4774-4aff-8dc5-2a7037a6d582 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 404 len: 111 microversion: 2.1 time: 0.030252 Jul 02 03:46:23.377428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 497/985] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:23 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:46:23.470942 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1186818714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832884585", "security_groups": [{"name": "tempest-secgroup-smoke-500091931"}], "block_device_mapping_v2": [{"uuid": "e810c146-c549-4643-92fb-f32a04d6986e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f1ef0821-e2dc-4511-8f33-8aac33bfb07d"}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:46:23.588948 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] validate_networks() for [('f1ef0821-e2dc-4511-8f33-8aac33bfb07d', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:46:24.090822 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:46:24.091220 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:46:24.091976 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:46:24.092360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:46:24.092778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:46:24.102467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:24.102914 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:24.103749 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:24.104188 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:24.122407 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:46:24.126525 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for user d42b42214d0d46bbb9fe90aed7f5e382 and project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:46:24.190296 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:46:24.193978 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e810c146-c549-4643-92fb-f32a04d6986e',volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:46:24.325426 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cf2cbc02-2c7c-4ca3-b6c4-4b8e7df53301 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.858368 Jul 02 03:46:24.326106 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 489/986] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:46:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:46:24.336754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-dc55649b-8c0a-4206-97ff-3e1dc88a9113 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:24.337504 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-dc55649b-8c0a-4206-97ff-3e1dc88a9113 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:24.394158 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-dc55649b-8c0a-4206-97ff-3e1dc88a9113 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:24.402486 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-dc55649b-8c0a-4206-97ff-3e1dc88a9113 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1095 microversion: 2.1 time: 0.070198 Jul 02 03:46:24.403096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 498/987] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:24 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:25.421461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:25.422848 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:25.430839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:25.431319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:25.432332 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:25.432846 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:25.498015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:25.507727 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-500b8735-a871-4e72-9343-777b4daae02a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1211 microversion: 2.1 time: 0.091103 Jul 02 03:46:25.508607 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 490/988] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:25 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:26.525575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:26.526769 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:26.537512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:26.538090 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:26.539190 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:26.540081 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:26.761403 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:26.770740 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7896cd2b-ef60-4631-9f7b-2bb46d6d99e9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.249294 Jul 02 03:46:26.781728 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 499/989] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:26 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:26.837734 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-b94451ff-70a6-4aac-8f8d-eaacb9e5293a req-e24bd6f2-e20b-4972-a5b5-3dbe70811dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca5d2e7-13ef-4686-ad55-082607c0fd4d", "tag": "09272599-5e76-4fdf-bc09-0dc405b5f132"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:46:26.850625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-b94451ff-70a6-4aac-8f8d-eaacb9e5293a req-e24bd6f2-e20b-4972-a5b5-3dbe70811dc1 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:26.851241 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-b94451ff-70a6-4aac-8f8d-eaacb9e5293a req-e24bd6f2-e20b-4972-a5b5-3dbe70811dc1 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:26.883006 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-b94451ff-70a6-4aac-8f8d-eaacb9e5293a req-e24bd6f2-e20b-4972-a5b5-3dbe70811dc1 service nova] Creating event network-changed:09272599-5e76-4fdf-bc09-0dc405b5f132 for instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d on hv-cinder-84684 Jul 02 03:46:26.888741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-b94451ff-70a6-4aac-8f8d-eaacb9e5293a req-e24bd6f2-e20b-4972-a5b5-3dbe70811dc1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055077 Jul 02 03:46:26.889758 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 491/990] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:46:27.788659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:27.789191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:27.796225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:27.796672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:27.797487 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:27.797922 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:27.940108 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:27.948456 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c2206ef8-d31c-4282-bbea-b1840b0a77b9 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.163849 Jul 02 03:46:27.951215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 500/991] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:27 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:28.966370 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:28.967110 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:28.974931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:28.975854 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:28.976697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:28.977289 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:29.130372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:29.140966 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d6939b6d-3958-4775-a156-f50c8eea3ad2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.179246 Jul 02 03:46:29.141728 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 492/992] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:28 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:30.158303 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:30.158909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:30.166389 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:30.167169 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:30.167979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:30.168441 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:30.310488 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:30.318195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-59a77ff5-d030-4497-acf2-2958efac067d tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.163878 Jul 02 03:46:30.318757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 501/993] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:30 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:31.336135 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:31.336756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:31.344132 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:31.344625 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:31.345550 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:31.345988 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:31.484143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:31.492263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-26df8e38-a21e-4aef-b15f-3280ce4d9d96 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.160693 Jul 02 03:46:31.493038 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 493/994] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:31 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:32.514373 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:32.515341 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:32.526712 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:32.527534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:32.528802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:32.529575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:32.671797 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:32.684249 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a5e3f53c-145f-4a2f-9f61-5b503367d09f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.176080 Jul 02 03:46:32.685017 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 502/995] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:32 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:33.702044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:33.702698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:33.710442 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:33.710940 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:33.711754 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:33.712222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:33.848231 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:33.859896 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-95219925-d31f-4258-a988-84e1bcbe9e7b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.161872 Jul 02 03:46:33.860724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 494/996] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:33 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:34.877511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:34.878095 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:34.880558 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:46:34.886604 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:34.887046 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:34.887843 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:34.888275 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:35.027038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:35.038859 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-76445857-3c57-4890-917a-4b780c1a861c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.165012 Jul 02 03:46:35.039632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 503/997] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:34 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:36.061568 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:36.062402 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:36.064863 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:46:36.065753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:46:36.073718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:36.074194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:36.075051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:36.075574 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:36.276555 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:36.284795 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b16eef62-7207-41d2-94bd-c9c7940d8c38 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.227165 Jul 02 03:46:36.285991 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 495/998] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:36 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:37.302592 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:37.303206 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:37.310754 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:37.311241 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:37.312175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:37.312637 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:37.488072 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:37.498121 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cd55567c-b6be-4d58-b58d-243ebd2a2eba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.199147 Jul 02 03:46:37.498892 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 504/999] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:37 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:37.578011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-5ae856bb-b83a-4845-9218-1d44be89416e req-c8ea5cb0-7637-4bd1-be72-2c6d9f074fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca5d2e7-13ef-4686-ad55-082607c0fd4d", "name": "network-vif-plugged", "status": "completed", "tag": "09272599-5e76-4fdf-bc09-0dc405b5f132"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:46:37.587252 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-5ae856bb-b83a-4845-9218-1d44be89416e req-c8ea5cb0-7637-4bd1-be72-2c6d9f074fc2 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:37.588093 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-5ae856bb-b83a-4845-9218-1d44be89416e req-c8ea5cb0-7637-4bd1-be72-2c6d9f074fc2 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:37.614953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-5ae856bb-b83a-4845-9218-1d44be89416e req-c8ea5cb0-7637-4bd1-be72-2c6d9f074fc2 service nova] Creating event network-vif-plugged:09272599-5e76-4fdf-bc09-0dc405b5f132 for instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d on hv-cinder-84684 Jul 02 03:46:37.621362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-5ae856bb-b83a-4845-9218-1d44be89416e req-c8ea5cb0-7637-4bd1-be72-2c6d9f074fc2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047481 Jul 02 03:46:37.622420 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 496/1000] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:46:38.520370 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:38.521353 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:38.532498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:38.533279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:38.534551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:38.535271 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:38.684987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:38.696505 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-673a9916-5ead-487b-98f8-b4986ef053d0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1266 microversion: 2.1 time: 0.182662 Jul 02 03:46:38.697086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 505/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:38 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:39.716519 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:39.717226 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:39.724455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:39.725033 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:39.725876 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:39.726328 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:39.871799 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:39.883496 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-98ce0cb0-10cf-4cbe-a4eb-e826bfa0af50 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1452 microversion: 2.1 time: 0.171767 Jul 02 03:46:39.884536 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 497/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:39 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:46:39.900635 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:46:39.901325 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:46:39.908119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:39.908495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:39.909251 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:39.909680 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:40.047988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:46:40.056251 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1c576cd7-1403-4537-8ca8-55d35b6561af tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1452 microversion: 2.1 time: 0.159663 Jul 02 03:46:40.056903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 506/1003] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:46:39 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:46:42.094674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-926e02f9-450e-406a-92ba-5c7b5a69d6e4 req-5fd1a2c7-a74e-495c-ae4a-1092763e01fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca5d2e7-13ef-4686-ad55-082607c0fd4d", "tag": "09272599-5e76-4fdf-bc09-0dc405b5f132"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:46:42.102641 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-926e02f9-450e-406a-92ba-5c7b5a69d6e4 req-5fd1a2c7-a74e-495c-ae4a-1092763e01fb service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:46:42.103092 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-926e02f9-450e-406a-92ba-5c7b5a69d6e4 req-5fd1a2c7-a74e-495c-ae4a-1092763e01fb service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:46:42.115047 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-926e02f9-450e-406a-92ba-5c7b5a69d6e4 req-5fd1a2c7-a74e-495c-ae4a-1092763e01fb service nova] Creating event network-changed:09272599-5e76-4fdf-bc09-0dc405b5f132 for instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d on hv-cinder-84684 Jul 02 03:46:42.120961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-926e02f9-450e-406a-92ba-5c7b5a69d6e4 req-5fd1a2c7-a74e-495c-ae4a-1092763e01fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215530 Jul 02 03:46:42.121569 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 498/1004] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:47:19.360317 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5b8c8214-2c06-4077-affc-ff1acf111856 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:19.360897 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5b8c8214-2c06-4077-affc-ff1acf111856 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:19.363131 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:47:19.363829 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:47:19.369874 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8c8214-2c06-4077-affc-ff1acf111856 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:19.370324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8c8214-2c06-4077-affc-ff1acf111856 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:19.371087 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8c8214-2c06-4077-affc-ff1acf111856 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:19.371545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5b8c8214-2c06-4077-affc-ff1acf111856 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:19.395038 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5b8c8214-2c06-4077-affc-ff1acf111856 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/ips" status: 200 len: 145 microversion: 2.1 time: 0.038795 Jul 02 03:47:19.395664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 507/1005] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:47:19 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:47:21.795724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fb1cb0d5-4f6e-4edc-8b8a-533a381eedd2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61969d34-c852-4351-add0-f123c1769b14"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:47:21.796864 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fb1cb0d5-4f6e-4edc-8b8a-533a381eedd2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:21.799028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:47:21.799687 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=62 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:47:21.806301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fb1cb0d5-4f6e-4edc-8b8a-533a381eedd2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:21.806773 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fb1cb0d5-4f6e-4edc-8b8a-533a381eedd2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:21.807575 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fb1cb0d5-4f6e-4edc-8b8a-533a381eedd2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:21.808015 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-fb1cb0d5-4f6e-4edc-8b8a-533a381eedd2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:22.105023 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fb1cb0d5-4f6e-4edc-8b8a-533a381eedd2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313829 Jul 02 03:47:22.105692 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 499/1006] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:47:21 2022] POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:47:29.666086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-82551aba-0b76-4ab5-bc2e-f560ee8afe3f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:47:29.669052 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:47:29.669690 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=4 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:47:29.675160 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-82551aba-0b76-4ab5-bc2e-f560ee8afe3f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:29.675652 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-82551aba-0b76-4ab5-bc2e-f560ee8afe3f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:29.738546 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-82551aba-0b76-4ab5-bc2e-f560ee8afe3f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Going to try to stop instance {{(pid=124512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 03:47:29.794560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-82551aba-0b76-4ab5-bc2e-f560ee8afe3f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action" status: 202 len: 0 microversion: 2.1 time: 0.134609 Jul 02 03:47:29.795077 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 508/1007] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:47:29 2022] POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:47:29.804479 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:29.805511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:29.813143 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:29.813769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:29.814716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:29.815156 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:29.956830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:29.965505 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4fdbb4c1-c71d-4c43-b3eb-efd2f50c41d5 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.165804 Jul 02 03:47:29.966058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 500/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:29 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:30.985554 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:30.986403 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:30.994111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:30.994576 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:30.995326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:30.995812 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:31.132229 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:31.141302 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-16ddee38-0375-4cba-aee8-22ef539fb494 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.161260 Jul 02 03:47:31.141869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 509/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:30 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:32.159720 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:32.160366 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:32.168518 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:32.169304 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:32.170595 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:32.171127 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:32.319720 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:32.328689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9aed6435-b4e7-4783-aa72-c3dfd4da73bb tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.173000 Jul 02 03:47:32.329260 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 501/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:32 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:33.349525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:33.350159 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:33.360549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:33.361114 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:33.362217 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:33.362859 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:33.503326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:33.512018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-60e0a48c-7595-4e6e-9564-47724ccef966 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.168810 Jul 02 03:47:33.512587 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 510/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:33 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:34.533741 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:34.534831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:34.546533 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:34.547279 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:34.548588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:34.549307 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:34.692885 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:34.701683 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-12024b7c-0b37-4f48-94f1-e9561cf734ba tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.175000 Jul 02 03:47:34.702251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 502/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:34 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:35.720436 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:35.721152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:35.729226 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:35.729745 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:35.730674 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:35.731212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:35.872415 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:35.880649 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f9d12271-09f3-4f20-9713-32aab657b3e6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.164972 Jul 02 03:47:35.881210 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 511/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:35 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:36.902477 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:36.903257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:36.911135 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:36.911614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:36.912385 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:36.912821 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:37.051049 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:37.059851 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b35296a7-22d8-44b4-8f9e-08255523912b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.164341 Jul 02 03:47:37.060412 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 503/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:36 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:38.077574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:38.078268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:38.085088 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:38.085534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:38.086291 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:38.086716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:38.227757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:38.236873 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f439658d-2f0a-45eb-887a-2ccba045f93c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.163380 Jul 02 03:47:38.237455 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 512/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:38 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:39.258273 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:39.259214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:39.270555 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:39.271342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:39.272620 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:39.273347 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:39.410708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:39.419802 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a6552af7-8481-44dd-a42b-31cf9e9da772 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.167918 Jul 02 03:47:39.420678 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 504/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:39 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:40.439722 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:40.440525 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:40.449528 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:40.450010 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:40.450807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:40.451315 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:40.585911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:40.594646 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-878c9336-b58c-45a5-9e33-0c6b2a16c5e3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1699 microversion: 2.1 time: 0.159637 Jul 02 03:47:40.595211 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 513/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:40 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:40.610999 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-01d43b8f-2e4e-4dfd-b828-153ec422a9c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:47:40.617825 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-01d43b8f-2e4e-4dfd-b828-153ec422a9c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:40.618276 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-01d43b8f-2e4e-4dfd-b828-153ec422a9c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:40.677943 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-01d43b8f-2e4e-4dfd-b828-153ec422a9c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Going to try to start instance {{(pid=124513) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 02 03:47:40.737733 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-01d43b8f-2e4e-4dfd-b828-153ec422a9c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action" status: 202 len: 0 microversion: 2.1 time: 0.130440 Jul 02 03:47:40.738526 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 505/1018] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:47:40 2022] POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:47:40.748145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:40.748941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:40.756319 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:40.756923 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:40.757863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:40.758392 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:40.895312 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:40.903700 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-690349d7-b675-4c77-ae61-50fca5dc22cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1708 microversion: 2.1 time: 0.159746 Jul 02 03:47:40.904298 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 514/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:40 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:41.925136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:41.926011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:41.934688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:41.935247 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:41.936277 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:41.936710 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:42.077006 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:42.085267 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-59df3dd0-6ec1-41f0-a4de-917c8bcd99d1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1708 microversion: 2.1 time: 0.165973 Jul 02 03:47:42.085848 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 506/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:41 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:47:43.107265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:47:43.108053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:47:43.115159 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:43.115732 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:43.116514 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:47:43.116946 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:47:43.250104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:47:43.262645 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7fc2da7c-5571-4b17-9250-7a0968a876ad tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1712 microversion: 2.1 time: 0.161639 Jul 02 03:47:43.263435 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 515/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:47:43 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1712 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:42.304112 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=16 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:42.304871 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:42.308791 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1855571722", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832884585", "security_groups": [{"name": "tempest-secgroup-smoke-500091931"}], "block_device_mapping_v2": [{"uuid": "e5b21cfb-5396-46bf-a615-b06fd9441997", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f1ef0821-e2dc-4511-8f33-8aac33bfb07d"}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:48:42.441580 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] validate_networks() for [('f1ef0821-e2dc-4511-8f33-8aac33bfb07d', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:48:42.835361 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:48:42.835868 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:48:42.836353 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:48:42.836771 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:48:42.837301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:48:42.847065 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:42.847557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:42.848372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:42.848812 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:42.867940 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:48:42.872372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Getting quotas for user d42b42214d0d46bbb9fe90aed7f5e382 and project 01fccbd11a4b4e859bec1a56f42315b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:48:42.931824 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:48:42.934029 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5b21cfb-5396-46bf-a615-b06fd9441997',volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:48:43.083270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [b395e313-bf97-4d81-aeb8-8c3ee5f69695] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 03:48:44.096826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [b395e313-bf97-4d81-aeb8-8c3ee5f69695] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40446. Jul 02 03:48:44.102882 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8de16160-fe40-44c8-b6d1-3dc9ec4574f0 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.800667 Jul 02 03:48:44.103549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 507/1022] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:48:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:48:44.111823 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=16 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:44.112874 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:44.116752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1735570b-5dbf-4203-8d31-afeeb4c0f701 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:44.117421 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1735570b-5dbf-4203-8d31-afeeb4c0f701 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:44.173071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1735570b-5dbf-4203-8d31-afeeb4c0f701 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:44.180104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1735570b-5dbf-4203-8d31-afeeb4c0f701 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1095 microversion: 2.1 time: 0.070112 Jul 02 03:48:44.180584 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 516/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:44 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:45.199648 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:45.200266 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:45.207124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:45.207611 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:45.208390 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:45.208834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:45.275939 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:45.283733 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b28ff38b-b60f-4d85-b4ec-2266e8b7a5ac tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1211 microversion: 2.1 time: 0.090403 Jul 02 03:48:45.284342 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 508/1024] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:45 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:46.302628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:46.303251 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:46.310642 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:46.311104 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:46.311936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:46.312373 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:46.455110 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:46.462659 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-26cae977-c827-433b-8657-c48688cdd0ff tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.164337 Jul 02 03:48:46.463233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 517/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:46 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:46.568158 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-2c2ef9bc-9d95-4a21-9a5c-dc741c4fdfe7 req-f2c17e70-cca2-4540-8a59-0be811aaa5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75879c5-ac51-40b8-9a6d-36434e1aaa7f", "tag": "4dc53dd8-5395-4d6b-8f82-5a179f72260f"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:48:46.578423 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-2c2ef9bc-9d95-4a21-9a5c-dc741c4fdfe7 req-f2c17e70-cca2-4540-8a59-0be811aaa5ae service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:46.579152 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-2c2ef9bc-9d95-4a21-9a5c-dc741c4fdfe7 req-f2c17e70-cca2-4540-8a59-0be811aaa5ae service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:46.592629 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-2c2ef9bc-9d95-4a21-9a5c-dc741c4fdfe7 req-f2c17e70-cca2-4540-8a59-0be811aaa5ae service nova] Creating event network-changed:4dc53dd8-5395-4d6b-8f82-5a179f72260f for instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f on hv-cinder-84684 Jul 02 03:48:46.598238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-2c2ef9bc-9d95-4a21-9a5c-dc741c4fdfe7 req-f2c17e70-cca2-4540-8a59-0be811aaa5ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035235 Jul 02 03:48:46.599888 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 509/1026] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:48:46.621554 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:46.622039 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:46.628850 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:46.629585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:46.630358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:46.630965 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:46.720477 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lazy-loading 'services' on Instance uuid c7f0da2c-7771-4e9c-9dfd-e5a12e452bba {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:48:46.798386 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3726814f-5731-46bb-a719-23e0e831ab4d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-volume_attachments/61969d34-c852-4351-add0-f123c1769b14" status: 202 len: 0 microversion: 2.1 time: 0.180544 Jul 02 03:48:46.805427 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 518/1027] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:48:46 2022] DELETE /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-volume_attachments/61969d34-c852-4351-add0-f123c1769b14 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:48:47.480455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:47.481195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:47.488035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:47.488518 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:47.489292 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:47.489750 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:47.626529 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:47.634097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-cc87ba05-fcdc-419a-b4e5-36dcf67f42c3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.157983 Jul 02 03:48:47.634630 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 510/1028] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:47 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:47.912024 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-666b558c-6e1f-4ac4-91d8-4e9ceb103a07 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:48:47.919177 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-666b558c-6e1f-4ac4-91d8-4e9ceb103a07 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:47.919664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-666b558c-6e1f-4ac4-91d8-4e9ceb103a07 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:47.941400 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-666b558c-6e1f-4ac4-91d8-4e9ceb103a07 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Going to try to stop instance {{(pid=124512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 03:48:47.985763 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-666b558c-6e1f-4ac4-91d8-4e9ceb103a07 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action" status: 202 len: 0 microversion: 2.1 time: 0.078493 Jul 02 03:48:47.986370 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 519/1029] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:48:47 2022] POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:48:47.994577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:47.995191 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:48.001488 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:48.001934 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:48.003173 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:48.003640 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:48.141627 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:48.150413 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-820b5b22-6a63-4563-a447-abc541340c0a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1722 microversion: 2.1 time: 0.159854 Jul 02 03:48:48.150984 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 511/1030] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:47 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:48.650889 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:48.651612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:48.658233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:48.658672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:48.659549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:48.659981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:48.793489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:48.801176 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-56cdb9e8-88f3-4d4b-acca-89ed4806c6b4 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.154870 Jul 02 03:48:48.801741 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 520/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:48 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:49.168772 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:49.169949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:49.179335 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:49.180017 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:49.180919 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:49.181356 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:49.348205 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:49.360134 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e265df94-5051-4e02-b835-efcb75b84f5b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.195878 Jul 02 03:48:49.360831 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 512/1032] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:49 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:49.822581 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:49.823568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:49.834433 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:49.835175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:49.836512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:49.836943 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:49.971268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:49.980813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1eeacdc5-1485-4fff-a93f-5cc1aa0a2aa8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.164846 Jul 02 03:48:49.981367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 521/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:49 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:50.385950 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:50.386653 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:50.395181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:50.395753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:50.396656 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:50.397207 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:50.545947 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:50.554319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7a77c8cb-802e-48aa-97b1-d9035dd9fe76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.173969 Jul 02 03:48:50.554968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 513/1034] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:50 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:51.002923 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:51.003853 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:51.012376 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:51.012820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:51.013663 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:51.014089 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:51.153468 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:51.161314 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ef3059cc-9270-44df-9138-b9e30a1e2db1 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.166155 Jul 02 03:48:51.161880 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 522/1035] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:50 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:51.573866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:51.574503 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:51.581485 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:51.581935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:51.582698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:51.583137 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:51.723689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:51.733553 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-06041343-e681-4e28-9737-1c16fd67a4d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.164454 Jul 02 03:48:51.734235 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 514/1036] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:51 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:52.178168 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:52.178739 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:52.185849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:52.186289 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:52.187063 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:52.187521 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:52.325664 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:52.335764 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d0706d66-4880-438d-abfe-0c3b96b190cc tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.161130 Jul 02 03:48:52.336685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 523/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:52 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:52.755743 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:52.756742 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:52.767451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:52.768146 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:52.769277 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:52.769893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:52.858577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:52.879871 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:52.905230 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:52.912991 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-40b0c012-de0b-44d2-9252-150d4dd3e944 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.163702 Jul 02 03:48:52.913549 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 515/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:52 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:53.136147 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:48:53.136351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Sat Jul 2 03:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:48:53.358521 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:53.359117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:53.368778 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:53.369107 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:53.369912 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:53.370348 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:53.513191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:53.521018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a6d7e81d-2d36-4f7f-8dac-717bd577dcbb tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.166483 Jul 02 03:48:53.521607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 524/1039] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:53 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:53.934613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:53.935474 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:53.946368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:53.946814 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:53.947613 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:53.948041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:54.095606 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:54.103455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c9c8fb38-abdc-4ff9-ac85-27e86013eae6 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.175776 Jul 02 03:48:54.104020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 516/1040] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:53 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:54.542290 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:54.543051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:54.545712 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:54.553832 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:54.554442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:54.555592 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:54.556173 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:54.699875 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:54.711787 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d2aeb0b2-97c3-4cd9-85a5-9e25aff48a58 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.175551 Jul 02 03:48:54.712540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 525/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:54 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:55.122089 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:55.122724 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:55.129813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:55.130259 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:55.131028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:55.131487 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:55.265884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:55.273654 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ab734e50-5806-4c21-a3e3-c39da03818b9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.155602 Jul 02 03:48:55.274243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 517/1042] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:55 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:55.733844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:55.734848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:55.745164 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:55.745695 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:55.746549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:55.747022 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:55.886344 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:55.893956 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-110c95bf-c6f6-4c44-8314-896d9bc994e3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.167220 Jul 02 03:48:55.894515 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 526/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:55 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:56.295960 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:56.296796 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:56.306587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:56.307039 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:56.307852 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:56.308285 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:56.448289 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:56.456472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9ba11199-c0fd-44c0-8e59-a7fa21f1a7d0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.167846 Jul 02 03:48:56.457021 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 518/1044] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:56 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:56.916442 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:56.917407 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:56.925029 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:56.925728 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:56.926572 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:56.927047 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:57.077941 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:57.088054 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b3503875-dbc3-4e38-8d0d-0638ef9f5806 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.177203 Jul 02 03:48:57.088613 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 527/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:56 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:57.477789 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:57.478407 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:57.485565 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:57.486011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:57.486773 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:57.487205 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:57.624103 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:57.631997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-bd8b56aa-8f6d-427b-a800-9eec3c2a8e7a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.160596 Jul 02 03:48:57.632558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 519/1046] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:57 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:58.105586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:58.106174 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:58.113959 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:58.114484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:58.115270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:58.115776 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:58.250827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:58.258512 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-387df030-9e30-41a3-bc46-c0bfb7b283ab tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.157166 Jul 02 03:48:58.259393 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 528/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:58 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:58.648373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:58.649003 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:58.656271 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:58.656757 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:58.657522 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:58.657958 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:58.785677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:58.794283 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-2ccf9901-fdb0-4daa-b9d7-d7e3d1b0f557 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1676 microversion: 2.1 time: 0.149783 Jul 02 03:48:58.794834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 520/1048] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:58 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:59.275985 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:59.276867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:59.283520 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:59.283971 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:59.284733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:59.285162 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:59.427286 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:59.437056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-00f5b6ce-4655-4b67-80e0-0472817f2629 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.165084 Jul 02 03:48:59.437628 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 529/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:59 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:59.815059 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:48:59.816057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:48:59.826257 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:59.826707 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:59.827569 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:59.828012 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:48:59.966439 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:48:59.974120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-5abba226-625f-4584-b907-35f6915298db tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1653 microversion: 2.1 time: 0.165939 Jul 02 03:48:59.974712 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 521/1050] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:48:59 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1653 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:48:59.990645 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6586f5c5-23e5-4738-b0b9-faa019db8997 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:48:59.996867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6586f5c5-23e5-4738-b0b9-faa019db8997 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:48:59.997308 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6586f5c5-23e5-4738-b0b9-faa019db8997 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:00.021607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6586f5c5-23e5-4738-b0b9-faa019db8997 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Going to try to start instance {{(pid=124512) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 02 03:49:00.056521 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:49:00.067145 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6586f5c5-23e5-4738-b0b9-faa019db8997 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action" status: 202 len: 0 microversion: 2.1 time: 0.080086 Jul 02 03:49:00.067705 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 530/1051] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:48:59 2022] POST /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:49:00.076274 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:00.077085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:00.083586 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:00.084035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:00.084803 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:00.085236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:00.092122 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-0919f965-335d-41ac-8f21-e297f39c5fc4 req-4cf8ee25-3737-425e-90eb-50b131017c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75879c5-ac51-40b8-9a6d-36434e1aaa7f", "name": "network-vif-plugged", "status": "completed", "tag": "4dc53dd8-5395-4d6b-8f82-5a179f72260f"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:49:00.102205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-0919f965-335d-41ac-8f21-e297f39c5fc4 req-4cf8ee25-3737-425e-90eb-50b131017c83 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:00.102205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-0919f965-335d-41ac-8f21-e297f39c5fc4 req-4cf8ee25-3737-425e-90eb-50b131017c83 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:00.116685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-0919f965-335d-41ac-8f21-e297f39c5fc4 req-4cf8ee25-3737-425e-90eb-50b131017c83 service nova] Creating event network-vif-plugged:4dc53dd8-5395-4d6b-8f82-5a179f72260f for instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f on hv-cinder-84684 Jul 02 03:49:00.122827 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-0919f965-335d-41ac-8f21-e297f39c5fc4 req-4cf8ee25-3737-425e-90eb-50b131017c83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035318 Jul 02 03:49:00.123972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 531/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:49:00.226999 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:00.234756 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-42df7db3-b1cf-43cd-9ed5-4fd58a260a03 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1662 microversion: 2.1 time: 0.162553 Jul 02 03:49:00.235323 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 522/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:00 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:49:00.455268 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:00.456066 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:00.462645 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:00.463160 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:00.463960 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:00.464566 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:00.595759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:00.603699 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-de74e57c-34b2-4409-8f18-6b881df084a2 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.153135 Jul 02 03:49:00.604245 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 532/1054] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:00 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:49:01.256461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:01.257368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:01.265937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:01.266390 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:01.267158 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:01.267628 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:01.405337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:01.413737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e70ef24d-a8fa-492e-86d1-f2db6a361fa9 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1662 microversion: 2.1 time: 0.163835 Jul 02 03:49:01.414310 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 523/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:01 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:49:01.620738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:01.621308 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:01.628367 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:01.628802 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:01.629576 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:01.630001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:01.760060 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:01.767968 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-88e19ce5-223f-4a9f-aabd-a12fe904fd2f tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1266 microversion: 2.1 time: 0.151166 Jul 02 03:49:01.768542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 533/1056] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:01 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:49:02.434874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:02.435485 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:02.442846 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:02.443304 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:02.444098 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:02.444558 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:02.603321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:02.607258 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=100 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:49:02.612897 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7292020b-f79c-47b8-8a01-7fbbf90f6dda tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1662 microversion: 2.1 time: 0.184021 Jul 02 03:49:02.613559 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 524/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:02 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1662 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:49:02.785588 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:02.786215 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:02.794715 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:02.795173 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:02.796021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:02.796484 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:02.968537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:02.981408 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fa7c4d0d-58b2-468f-9d87-a6597548093c tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1452 microversion: 2.1 time: 0.199178 Jul 02 03:49:02.982257 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 534/1058] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:02 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:49:02.998290 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:02.998986 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:03.009251 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:03.009910 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:03.010837 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:03.011472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:03.169839 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:03.181364 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1755a6b1-4417-4186-905f-648b4547afba tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1452 microversion: 2.1 time: 0.187144 Jul 02 03:49:03.181961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 525/1059] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:02 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:49:03.631764 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:49:03.632297 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:49:03.639475 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:03.639932 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:03.640716 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:03.641138 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:04.017045 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:49:04.024788 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-941ba784-079d-4684-ab02-1655f575f55c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1666 microversion: 2.1 time: 0.397038 Jul 02 03:49:04.025328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 535/1060] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:49:03 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1666 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:49:05.300862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-db226aef-7d63-4389-945f-a5a9256a4eb2 req-94e6a085-f0c4-4cb6-8613-174c27bd4702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75879c5-ac51-40b8-9a6d-36434e1aaa7f", "tag": "4dc53dd8-5395-4d6b-8f82-5a179f72260f"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:49:05.310377 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-db226aef-7d63-4389-945f-a5a9256a4eb2 req-94e6a085-f0c4-4cb6-8613-174c27bd4702 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:49:05.310890 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-db226aef-7d63-4389-945f-a5a9256a4eb2 req-94e6a085-f0c4-4cb6-8613-174c27bd4702 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:49:05.322425 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-db226aef-7d63-4389-945f-a5a9256a4eb2 req-94e6a085-f0c4-4cb6-8613-174c27bd4702 service nova] Creating event network-changed:4dc53dd8-5395-4d6b-8f82-5a179f72260f for instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f on hv-cinder-84684 Jul 02 03:49:05.328148 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-db226aef-7d63-4389-945f-a5a9256a4eb2 req-94e6a085-f0c4-4cb6-8613-174c27bd4702 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030783 Jul 02 03:49:05.328689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 526/1061] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:50:07.593274 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=42 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:50:07.594097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=26 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:50:07.598527 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ca0168cb-bf3f-46b3-a57e-0de7b20e1911 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:07.599545 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ca0168cb-bf3f-46b3-a57e-0de7b20e1911 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:07.608441 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca0168cb-bf3f-46b3-a57e-0de7b20e1911 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:07.608893 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca0168cb-bf3f-46b3-a57e-0de7b20e1911 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:07.609660 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca0168cb-bf3f-46b3-a57e-0de7b20e1911 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:07.610115 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca0168cb-bf3f-46b3-a57e-0de7b20e1911 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:07.640995 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ca0168cb-bf3f-46b3-a57e-0de7b20e1911 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049672 Jul 02 03:50:07.641534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 536/1062] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:50:07 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:50:07.714895 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:50:07.715657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=8 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:50:07.719977 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:07.720820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:07.728518 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:07.728959 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:07.729714 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:07.730142 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:07.757152 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:50:07.838772 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a8e2b201-4cd5-4e82-b0eb-61a290e0a9cf tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 204 len: 0 microversion: 2.1 time: 0.125494 Jul 02 03:50:07.839686 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 527/1063] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:50:07 2022] DELETE /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:50:07.848445 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:07.849053 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:07.855401 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:07.855848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:07.856617 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:07.857068 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:07.988279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:07.995840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2de662ac-3861-4bd8-9704-9be27148f150 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1672 microversion: 2.1 time: 0.151684 Jul 02 03:50:07.996397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 537/1064] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:07 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:09.018070 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:09.018818 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:09.026298 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:09.026774 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:09.027623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:09.028089 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:09.264506 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:09.272817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-85f0dc67-0cf4-4b4a-817b-b5407dfc333a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1672 microversion: 2.1 time: 0.261714 Jul 02 03:50:09.273321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 528/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:09 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:10.290721 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:10.291351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:10.298867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:10.299328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:10.300310 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:10.300738 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:10.431986 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:10.439602 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c954e2a9-d167-483e-85d9-4a172db836b0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1672 microversion: 2.1 time: 0.152857 Jul 02 03:50:10.440170 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 538/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:10 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:11.008686 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-a2475b55-f9de-49c5-9626-cc750e642240 req-468013ba-7fd6-4cc8-b1dc-87fab5bf7023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f0da2c-7771-4e9c-9dfd-e5a12e452bba", "name": "network-vif-deleted", "tag": "9dc25d19-95aa-4170-9015-29cd666dc12e"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:50:11.021379 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-a2475b55-f9de-49c5-9626-cc750e642240 req-468013ba-7fd6-4cc8-b1dc-87fab5bf7023 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:11.021833 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-a2475b55-f9de-49c5-9626-cc750e642240 req-468013ba-7fd6-4cc8-b1dc-87fab5bf7023 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:11.033319 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-a2475b55-f9de-49c5-9626-cc750e642240 req-468013ba-7fd6-4cc8-b1dc-87fab5bf7023 service nova] Creating event network-vif-deleted:9dc25d19-95aa-4170-9015-29cd666dc12e for instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba on hv-cinder-84684 Jul 02 03:50:11.042417 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-a2475b55-f9de-49c5-9626-cc750e642240 req-468013ba-7fd6-4cc8-b1dc-87fab5bf7023 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Jul 02 03:50:11.043162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 529/1067] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:50:11.462782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:11.463181 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:11.469713 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:11.470165 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:11.470972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:11.471444 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:11.506043 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:11.506260 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:11.506647 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lazy-loading 'fault' on Instance uuid c7f0da2c-7771-4e9c-9dfd-e5a12e452bba {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:50:11.609518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:11.618371 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-fb94e5b9-fff7-4e19-9445-6e29e91d0107 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 200 len: 1327 microversion: 2.1 time: 0.159405 Jul 02 03:50:11.619681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 539/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:11 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 1327 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:12.641857 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:12.642624 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:12.649900 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:12.650363 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:12.651133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:12.651604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:12.665874 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] HTTP exception thrown: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Request method failure captured: Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba HTTP/1.1 Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv79h1c93TZjcNcKGnA1ji0XJClw4hnMhduQ2JAbEByx-gOn3AI37RJRI9wlBibfmCbEZV9Ykri5By48Ki86bNpGaRLvpF3-50i2OSWGaNz2wY1DwNs8SiR3apyua9-sDdvNmMwG0_JV_kSPO8pYmC3ZfJ-iaIXgrDxwff_ThDefCVWU Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:50:12.667996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0665267ba574490cbcf958be4d793dd3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: e80e09005b7e4cdc8f42be866dbd91bb Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:50:12.669715 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'c7f0da2c-7771-4e9c-9dfd-e5a12e452bba'} Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:50:12.671063 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:50:12.672798 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:50:12.674373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Returning 404 to user: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:50:12.674373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-30165506-0261-46f8-911f-b87a1df8dac4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 404 len: 111 microversion: 2.1 time: 0.034353 Jul 02 03:50:12.674373 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 530/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:12 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:50:12.678588 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f878b31b-5e30-4386-9281-8541aad1913a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '.version_select at 0x7f2e97547790>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:12.681849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f878b31b-5e30-4386-9281-8541aad1913a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [c962c284-e76c-43b8-b129-c1f85b8f71be] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 03:50:13.693375 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [None req-f878b31b-5e30-4386-9281-8541aad1913a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [c962c284-e76c-43b8-b129-c1f85b8f71be] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40622. Jul 02 03:50:13.716846 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f878b31b-5e30-4386-9281-8541aad1913a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-798240496" status: 202 len: 0 microversion: 2.1 time: 1.042184 Jul 02 03:50:13.717407 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 540/1070] 10.222.0.42 () {58 vars in 1217 bytes} [Sat Jul 2 03:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-798240496 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:50:14.377020 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8057bcfc-6724-4f42-bd30-b4e95cac10fd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'create', calling method: .version_select at 0x7f2e974cea60>, body: {"keypair": {"name": "tempest-keypair-1384341555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPxll0uViA2tBi9EsooHrdQImpcFF053+X0eiVJ5b3bqqEJ4XqoKXWWr+IwKwR6pef+XAnwGTjg+kPpEDBlG1nRXyvm2hvcKIpDBGlPdDu2IbYnR0O2MC/B4gNn7Jiueg=="}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:50:14.392899 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-8057bcfc-6724-4f42-bd30-b4e95cac10fd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for project 0665267ba574490cbcf958be4d793dd3. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:50:14.397076 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-8057bcfc-6724-4f42-bd30-b4e95cac10fd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for user e80e09005b7e4cdc8f42be866dbd91bb and project 0665267ba574490cbcf958be4d793dd3. Resources: {'key_pairs'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:50:14.427865 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8057bcfc-6724-4f42-bd30-b4e95cac10fd tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054811 Jul 02 03:50:14.428458 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 531/1071] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:50:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:50:15.765820 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-347697859", "imageRef": "3136cffc-59b5-4019-bc6e-20ca057136a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2526fc80-7281-4aad-9a6a-6587590ab6d6"}], "security_groups": [{"name": "tempest-securitygroup--986508311"}], "key_name": "tempest-keypair-1384341555", "user_data": "}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:50:15.876813 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.network.neutron [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] validate_networks() for [('2526fc80-7281-4aad-9a6a-6587590ab6d6', None, None, None, None, None)] {{(pid=124512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:50:16.309096 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Flavor limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:50:16.309768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Image limits 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:50:16.310420 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Flavor pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:50:16.310970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Image pref 0:0:0 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:50:16.311591 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.virt.hardware [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:50:16.322585 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:16.323021 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:16.323859 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:16.324319 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:16.342518 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for project 0665267ba574490cbcf958be4d793dd3. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:50:16.347012 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Getting quotas for user e80e09005b7e4cdc8f42be866dbd91bb and project 0665267ba574490cbcf958be4d793dd3. Resources: {'ram', 'instances', 'cores'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:50:16.359066 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Going to run 1 instances... {{(pid=124512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:50:16.361388 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3136cffc-59b5-4019-bc6e-20ca057136a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:50:16.409731 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-54149113-9370-4e90-af7b-ca3e5cafe40f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.648650 Jul 02 03:50:16.410357 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 541/1072] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:50:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:50:16.427696 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-ab7f4345-a1dd-440b-be69-7cec599ba5c0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:16.428307 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-ab7f4345-a1dd-440b-be69-7cec599ba5c0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:16.483506 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-ab7f4345-a1dd-440b-be69-7cec599ba5c0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:16.491193 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-ab7f4345-a1dd-440b-be69-7cec599ba5c0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1237 microversion: 2.1 time: 0.070490 Jul 02 03:50:16.492507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 532/1073] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:16 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:17.509686 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:17.511000 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:17.520138 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:17.520667 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:17.521875 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:17.522319 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:17.604530 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:17.612198 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-35ed37c2-ed77-42ee-b2fc-399a775fea90 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1307 microversion: 2.1 time: 0.106990 Jul 02 03:50:17.612805 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 542/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:17 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:18.630048 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:18.630657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:18.637906 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:18.638378 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:18.639117 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:18.639583 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:18.780282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:18.788747 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c06a7b9b-fc81-427a-ad9a-f4f3dfe11336 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.162537 Jul 02 03:50:18.789282 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 533/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:18 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:18.886070 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-2026f723-2dab-4f58-bb92-3a69669c8f98 req-c2c0b6c1-2ce9-4030-9396-3d9b8fdec785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e19df2f-a704-4cba-93a1-031ac21b3998", "tag": "26c8b138-e3db-46c8-b558-dc25b48aed1b"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:50:18.895532 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-2026f723-2dab-4f58-bb92-3a69669c8f98 req-c2c0b6c1-2ce9-4030-9396-3d9b8fdec785 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:18.896345 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-2026f723-2dab-4f58-bb92-3a69669c8f98 req-c2c0b6c1-2ce9-4030-9396-3d9b8fdec785 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:18.919511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-2026f723-2dab-4f58-bb92-3a69669c8f98 req-c2c0b6c1-2ce9-4030-9396-3d9b8fdec785 service nova] Creating event network-changed:26c8b138-e3db-46c8-b558-dc25b48aed1b for instance 4e19df2f-a704-4cba-93a1-031ac21b3998 on hv-cinder-84684 Jul 02 03:50:18.925149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-2026f723-2dab-4f58-bb92-3a69669c8f98 req-c2c0b6c1-2ce9-4030-9396-3d9b8fdec785 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042482 Jul 02 03:50:18.929036 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 543/1076] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:50:19.809689 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:19.810695 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:19.820371 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:19.820816 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:19.821579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:19.822018 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:19.953806 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:19.961725 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-11eeb4a1-adff-48f5-b28e-b3d4f6f86c76 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.158598 Jul 02 03:50:19.962293 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 534/1077] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:19 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:20.983726 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:20.984856 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:20.994069 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:20.994513 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:20.995267 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:20.995727 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:21.143248 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:21.150972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c4475266-3846-4f5d-b081-067110e7ae12 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.175010 Jul 02 03:50:21.151553 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 544/1078] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:20 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:22.168177 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:22.168766 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:22.176025 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:22.176471 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:22.177221 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:22.177686 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:22.313931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:22.321727 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-467db064-5ca5-41d4-af29-200dd86f7dce tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.157820 Jul 02 03:50:22.322288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 535/1079] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:22 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:23.342787 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:23.344270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:23.354086 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:23.354526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:23.355324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:23.355752 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:23.504406 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:23.515390 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cb3e6915-5afc-40eb-a869-ab7655a271af tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.179466 Jul 02 03:50:23.516150 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 545/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:23 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:24.536718 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:24.537387 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:24.544975 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:24.545434 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:24.546206 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:24.546647 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:24.676896 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:24.686224 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-169fbb47-2733-442b-9a94-148252c9dc25 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.153435 Jul 02 03:50:24.686785 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 536/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:24 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:25.705831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:25.706607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:25.716308 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:25.716908 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:25.717998 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:25.718616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:25.852498 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:25.860365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-bcdadf6e-6363-44e9-8556-0a908b8bced7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.160362 Jul 02 03:50:25.860965 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 546/1082] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:25 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:26.447935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-24111c66-824f-40db-a132-1a830800b367 req-b318a3db-e542-4e6e-ba6a-fd561cdf4ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e19df2f-a704-4cba-93a1-031ac21b3998", "name": "network-vif-plugged", "status": "completed", "tag": "26c8b138-e3db-46c8-b558-dc25b48aed1b"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:50:26.457881 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-24111c66-824f-40db-a132-1a830800b367 req-b318a3db-e542-4e6e-ba6a-fd561cdf4ae3 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:26.458328 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-24111c66-824f-40db-a132-1a830800b367 req-b318a3db-e542-4e6e-ba6a-fd561cdf4ae3 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:26.471349 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-24111c66-824f-40db-a132-1a830800b367 req-b318a3db-e542-4e6e-ba6a-fd561cdf4ae3 service nova] Creating event network-vif-plugged:26c8b138-e3db-46c8-b558-dc25b48aed1b for instance 4e19df2f-a704-4cba-93a1-031ac21b3998 on hv-cinder-84684 Jul 02 03:50:26.476601 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-24111c66-824f-40db-a132-1a830800b367 req-b318a3db-e542-4e6e-ba6a-fd561cdf4ae3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033071 Jul 02 03:50:26.477199 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 537/1083] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:50:26.881385 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:26.882001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:26.884167 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=2 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:50:26.884849 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=6 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:50:26.891737 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:26.892233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:26.893064 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:26.893536 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:27.032685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:27.040318 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-48bb7b69-a1bc-42a7-a343-24faf82b101e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.163441 Jul 02 03:50:27.040878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 547/1084] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:26 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:28.056922 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=6 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:50:28.063427 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:28.064134 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:28.071127 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:28.071609 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:28.072384 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:28.072817 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:28.206800 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:28.214678 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c1e75319-cb9c-4f08-9ca5-82051208aca0 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1362 microversion: 2.1 time: 0.159723 Jul 02 03:50:28.215244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 538/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:28 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:29.233084 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:29.233681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:29.240854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:29.241313 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:29.242080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:29.242549 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:29.380579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:50:29.388502 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3c41cdf5-2711-485f-9efd-02abb912b8c2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1548 microversion: 2.1 time: 0.160010 Jul 02 03:50:29.389120 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 548/1086] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:50:29 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:50:29.404934 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c523e5cc-0890-4b50-9726-ddd40f0ce8e7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:50:29.405454 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c523e5cc-0890-4b50-9726-ddd40f0ce8e7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:50:29.412218 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c523e5cc-0890-4b50-9726-ddd40f0ce8e7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:29.412670 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c523e5cc-0890-4b50-9726-ddd40f0ce8e7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:29.413435 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c523e5cc-0890-4b50-9726-ddd40f0ce8e7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:29.413869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c523e5cc-0890-4b50-9726-ddd40f0ce8e7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:29.497797 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c523e5cc-0890-4b50-9726-ddd40f0ce8e7 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096671 Jul 02 03:50:29.498647 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 539/1087] 10.222.0.42 () {58 vars in 1274 bytes} [Sat Jul 2 03:50:29 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:50:30.436281 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-757268ca-ed42-4976-a9b1-9e941746d093 req-a1dd098d-7043-4fb1-99f2-b3986e8bdd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e19df2f-a704-4cba-93a1-031ac21b3998", "tag": "26c8b138-e3db-46c8-b558-dc25b48aed1b"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:50:30.444981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-757268ca-ed42-4976-a9b1-9e941746d093 req-a1dd098d-7043-4fb1-99f2-b3986e8bdd32 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:50:30.445418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-757268ca-ed42-4976-a9b1-9e941746d093 req-a1dd098d-7043-4fb1-99f2-b3986e8bdd32 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:50:30.456581 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-757268ca-ed42-4976-a9b1-9e941746d093 req-a1dd098d-7043-4fb1-99f2-b3986e8bdd32 service nova] Creating event network-changed:26c8b138-e3db-46c8-b558-dc25b48aed1b for instance 4e19df2f-a704-4cba-93a1-031ac21b3998 on hv-cinder-84684 Jul 02 03:50:30.461573 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-757268ca-ed42-4976-a9b1-9e941746d093 req-a1dd098d-7043-4fb1-99f2-b3986e8bdd32 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029351 Jul 02 03:50:30.462253 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 549/1088] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:51:05.199559 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:05.200368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:05.204645 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:05.205149 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:05.209418 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:05.210584 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=68 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:05.214769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:05.215487 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:05.216136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:05.216569 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:05.246108 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:51:05.287008 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-5fff1817-f496-43bd-9dbd-c912aab1befb req-2da594d3-1865-4963-a4ac-1815dd763981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75879c5-ac51-40b8-9a6d-36434e1aaa7f", "tag": "4dc53dd8-5395-4d6b-8f82-5a179f72260f"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:51:05.296765 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-5fff1817-f496-43bd-9dbd-c912aab1befb req-2da594d3-1865-4963-a4ac-1815dd763981 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:05.297135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-5fff1817-f496-43bd-9dbd-c912aab1befb req-2da594d3-1865-4963-a4ac-1815dd763981 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:05.310005 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-5fff1817-f496-43bd-9dbd-c912aab1befb req-2da594d3-1865-4963-a4ac-1815dd763981 service nova] Creating event network-changed:4dc53dd8-5395-4d6b-8f82-5a179f72260f for instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f on hv-cinder-84684 Jul 02 03:51:05.315536 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-5fff1817-f496-43bd-9dbd-c912aab1befb req-2da594d3-1865-4963-a4ac-1815dd763981 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113158 Jul 02 03:51:05.316524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 550/1089] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:51:05.334753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f094470a-dd3e-40ae-9b41-cbfe46ae8b3a tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 204 len: 0 microversion: 2.1 time: 0.136338 Jul 02 03:51:05.338889 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 540/1090] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:51:05 2022] DELETE /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:51:05.345051 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:05.345939 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:05.352575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:05.353108 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:05.353906 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:05.354340 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:05.496185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:51:05.505067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d1f7edf5-f847-4afd-b6fa-c5243f60f056 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1577 microversion: 2.1 time: 0.164120 Jul 02 03:51:05.505657 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 551/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:05 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 03:51:06.523236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:06.524113 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:06.530979 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:06.531463 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:06.532247 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:06.532691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:06.677640 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:51:06.686119 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8751e79d-99b0-4c00-823d-783f622d5847 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1577 microversion: 2.1 time: 0.167470 Jul 02 03:51:06.686707 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 541/1092] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:06 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:51:07.704361 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:07.704962 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:07.713261 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:07.713636 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:07.714405 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:07.714869 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:07.866030 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:51:07.874786 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-6622929e-490c-4d0a-af94-e9f9082967a7 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 200 len: 1458 microversion: 2.1 time: 0.175232 Jul 02 03:51:07.875415 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 552/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:07 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 1458 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:51:07.893694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-1e860204-5a30-481d-ac38-4078262fdda4 req-01dfe5fe-3023-4902-8748-eb4a6f5744c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75879c5-ac51-40b8-9a6d-36434e1aaa7f", "name": "network-vif-deleted", "tag": "4dc53dd8-5395-4d6b-8f82-5a179f72260f"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:51:07.902597 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-1e860204-5a30-481d-ac38-4078262fdda4 req-01dfe5fe-3023-4902-8748-eb4a6f5744c9 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:07.903043 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-1e860204-5a30-481d-ac38-4078262fdda4 req-01dfe5fe-3023-4902-8748-eb4a6f5744c9 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:07.914337 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-1e860204-5a30-481d-ac38-4078262fdda4 req-01dfe5fe-3023-4902-8748-eb4a6f5744c9 service nova] Creating event network-vif-deleted:4dc53dd8-5395-4d6b-8f82-5a179f72260f for instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f on hv-cinder-84684 Jul 02 03:51:07.920284 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-1e860204-5a30-481d-ac38-4078262fdda4 req-01dfe5fe-3023-4902-8748-eb4a6f5744c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030403 Jul 02 03:51:07.921042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 542/1094] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:51:08.891534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:08.892138 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: e75879c5-ac51-40b8-9a6d-36434e1aaa7f] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:08.900283 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:08.900769 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:08.901572 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:08.901999 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:08.916374 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] HTTP exception thrown: Instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f could not be found. Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Request method failure captured: Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f HTTP/1.1 Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv77CUrRmfK1tR1dnKBeNQKCoYBSSnbJtBrbwHF5ec1FDuxkUe-yHxoLR0jU50oLefgl9wZv3a6_5_Ln1wzbJi2VPRzJruKwqKlKGm2byxC89RD-DkAuI9NIWTBPbBLAhQWo8owbEIhPhdXgSyLukeX-bBRkpCAGDy85GNeFu6T4uC_c Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:51:08.918560 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_01fccbd11a4b4e859bec1a56f42315b2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: d42b42214d0d46bbb9fe90aed7f5e382 Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f could not be found. Jul 02 03:51:08.920306 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'e75879c5-ac51-40b8-9a6d-36434e1aaa7f'} Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f could not be found. Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:51:08.921235 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f could not be found. Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f could not be found. Jul 02 03:51:08.922807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:08.924295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Returning 404 to user: Instance e75879c5-ac51-40b8-9a6d-36434e1aaa7f could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:51:08.924295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-53f41509-db63-49e7-83e5-99c391032b4b tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f" status: 404 len: 111 microversion: 2.1 time: 0.032366 Jul 02 03:51:08.924295 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 553/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:08 2022] GET /compute/v2.1/servers/e75879c5-ac51-40b8-9a6d-36434e1aaa7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:51:12.045899 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:12.046489 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:12.047097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-c4a583e9-a069-4edf-a42b-bc7cefbc32f0 req-679728a1-7626-47e2-8858-130dda14c26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca5d2e7-13ef-4686-ad55-082607c0fd4d", "tag": "09272599-5e76-4fdf-bc09-0dc405b5f132"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:51:12.052904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:12.053359 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:12.054211 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:12.054565 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:12.056538 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-c4a583e9-a069-4edf-a42b-bc7cefbc32f0 req-679728a1-7626-47e2-8858-130dda14c26e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:12.057270 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-c4a583e9-a069-4edf-a42b-bc7cefbc32f0 req-679728a1-7626-47e2-8858-130dda14c26e service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:12.069624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-c4a583e9-a069-4edf-a42b-bc7cefbc32f0 req-679728a1-7626-47e2-8858-130dda14c26e service nova] Creating event network-changed:09272599-5e76-4fdf-bc09-0dc405b5f132 for instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d on hv-cinder-84684 Jul 02 03:51:12.074815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-c4a583e9-a069-4edf-a42b-bc7cefbc32f0 req-679728a1-7626-47e2-8858-130dda14c26e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031561 Jul 02 03:51:12.075831 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 554/1096] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:51:12.084440 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:51:12.176502 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-590def12-bbf8-4861-bda3-e7b431cd40f5 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 204 len: 0 microversion: 2.1 time: 0.134588 Jul 02 03:51:12.177757 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 543/1097] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:51:12 2022] DELETE /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:51:12.187328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:12.188080 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:12.195864 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:12.196318 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:12.197114 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:12.197551 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:12.334554 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:51:12.342421 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-02bf78e4-6332-40b2-ad41-824f09d912c8 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1576 microversion: 2.1 time: 0.159493 Jul 02 03:51:12.342985 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 555/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:12 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:51:13.366667 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:13.367492 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:13.374271 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:13.374736 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:13.375538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:13.375980 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:13.508913 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:51:13.516587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-1781f761-a450-48e4-8993-624d7a849aaf tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1576 microversion: 2.1 time: 0.158515 Jul 02 03:51:13.517152 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 544/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:13 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:51:14.534975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:14.537347 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:14.545372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:14.545833 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:14.546774 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:14.547210 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:14.587073 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-9f382db0-6023-431c-b6e1-f9649968a59e req-c9e0f7dc-97e0-4b80-b56d-f64b38bc98ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca5d2e7-13ef-4686-ad55-082607c0fd4d", "name": "network-vif-deleted", "tag": "09272599-5e76-4fdf-bc09-0dc405b5f132"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:51:14.596456 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-9f382db0-6023-431c-b6e1-f9649968a59e req-c9e0f7dc-97e0-4b80-b56d-f64b38bc98ee service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:14.596893 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-9f382db0-6023-431c-b6e1-f9649968a59e req-c9e0f7dc-97e0-4b80-b56d-f64b38bc98ee service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:14.609144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-9f382db0-6023-431c-b6e1-f9649968a59e req-c9e0f7dc-97e0-4b80-b56d-f64b38bc98ee service nova] Creating event network-vif-deleted:09272599-5e76-4fdf-bc09-0dc405b5f132 for instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d on hv-cinder-84684 Jul 02 03:51:14.614199 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-9f382db0-6023-431c-b6e1-f9649968a59e req-c9e0f7dc-97e0-4b80-b56d-f64b38bc98ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031224 Jul 02 03:51:14.614879 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 545/1100] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 03:51:14.618368 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42b42214d0d46bbb9fe90aed7f5e382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fccbd11a4b4e859bec1a56f42315b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:51:14.628565 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4d461931-c2ae-489b-a01e-cc84a573aae3 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 200 len: 1391 microversion: 2.1 time: 0.097796 Jul 02 03:51:14.629101 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 556/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:14 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 1391 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:51:15.648723 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:15.649310 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: 4ca5d2e7-13ef-4686-ad55-082607c0fd4d] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:15.656104 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:15.656537 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:15.657321 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:15.657762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:15.672351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] HTTP exception thrown: Instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d could not be found. Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Request method failure captured: Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d HTTP/1.1 Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv77CUrRmfK1tR1dnKBeNQKCoYBSSnbJtBrbwHF5ec1FDuxkUe-yHxoLR0jU50oLefgl9wZv3a6_5_Ln1wzbJi2VPRzJruKwqKlKGm2byxC89RD-DkAuI9NIWTBPbBLAhQWo8owbEIhPhdXgSyLukeX-bBRkpCAGDy85GNeFu6T4uC_c Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:51:15.674090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_01fccbd11a4b4e859bec1a56f42315b2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: d42b42214d0d46bbb9fe90aed7f5e382 Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d could not be found. Jul 02 03:51:15.675794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '4ca5d2e7-13ef-4686-ad55-082607c0fd4d'} Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d could not be found. Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:51:15.680085 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d could not be found. Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d could not be found. Jul 02 03:51:15.682216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:15.683658 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Returning 404 to user: Instance 4ca5d2e7-13ef-4686-ad55-082607c0fd4d could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:51:15.683658 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-91c171a7-9c0c-4267-8d7a-f73aa9067722 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d" status: 404 len: 111 microversion: 2.1 time: 0.032561 Jul 02 03:51:15.683658 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 546/1102] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:15 2022] GET /compute/v2.1/servers/4ca5d2e7-13ef-4686-ad55-082607c0fd4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:51:16.159069 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:16.159632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:16.167555 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:16.168002 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:16.168785 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:16.169212 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:16.182876 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] HTTP exception thrown: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Request method failure captured: Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b HTTP/1.1 Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv77CUrRmfK1tR1dnKBeNQKCoYBSSnbJtBrbwHF5ec1FDuxkUe-yHxoLR0jU50oLefgl9wZv3a6_5_Ln1wzbJi2VPRzJruKwqKlKGm2byxC89RD-DkAuI9NIWTBPbBLAhQWo8owbEIhPhdXgSyLukeX-bBRkpCAGDy85GNeFu6T4uC_c Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:51:16.184557 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_01fccbd11a4b4e859bec1a56f42315b2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: d42b42214d0d46bbb9fe90aed7f5e382 Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.186202 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'ea0acb8d-32fc-45d8-92c5-50acf318209b'} Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:51:16.187203 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.188575 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.189970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Returning 404 to user: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:51:16.189970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2070a6ae-15ed-4abc-bdc7-1eb920157103 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 404 len: 111 microversion: 2.1 time: 0.030927 Jul 02 03:51:16.189970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 557/1103] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:51:16 2022] DELETE /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:51:16.197642 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:16.198665 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] [instance: ea0acb8d-32fc-45d8-92c5-50acf318209b] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:16.208202 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:16.208733 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:16.209529 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:16.210016 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:16.223593 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] HTTP exception thrown: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Request method failure captured: Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b HTTP/1.1 Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv77CUrRmfK1tR1dnKBeNQKCoYBSSnbJtBrbwHF5ec1FDuxkUe-yHxoLR0jU50oLefgl9wZv3a6_5_Ln1wzbJi2VPRzJruKwqKlKGm2byxC89RD-DkAuI9NIWTBPbBLAhQWo8owbEIhPhdXgSyLukeX-bBRkpCAGDy85GNeFu6T4uC_c Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:51:16.225144 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/01fccbd11a4b4e859bec1a56f42315b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_01fccbd11a4b4e859bec1a56f42315b2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 01fccbd11a4b4e859bec1a56f42315b2 Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-TestVolumeBootPattern-1625828201 Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: d42b42214d0d46bbb9fe90aed7f5e382 Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-TestVolumeBootPattern-1625828201-project Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.226762 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'ea0acb8d-32fc-45d8-92c5-50acf318209b'} Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:51:16.227815 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. Jul 02 03:51:16.229074 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:51:16.230312 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Returning 404 to user: Instance ea0acb8d-32fc-45d8-92c5-50acf318209b could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:51:16.230312 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-02b167d2-9070-46a3-9e11-bc228774fe78 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b" status: 404 len: 111 microversion: 2.1 time: 0.035528 Jul 02 03:51:16.230312 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 547/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:51:16 2022] GET /compute/v2.1/servers/ea0acb8d-32fc-45d8-92c5-50acf318209b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 03:51:17.543456 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c32a65ab-b48f-4003-a621-1b2ad271ba52 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] Calling method '.version_select at 0x7f2e975b50d0>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:17.567743 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c32a65ab-b48f-4003-a621-1b2ad271ba52 tempest-TestVolumeBootPattern-1625828201 tempest-TestVolumeBootPattern-1625828201-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1832884585" status: 202 len: 0 microversion: 2.1 time: 0.028139 Jul 02 03:51:17.568395 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 558/1105] 10.222.0.42 () {58 vars in 1262 bytes} [Sat Jul 2 03:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1832884585 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:51:45.733980 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:45.734691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:45.978691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-af461fcf-8a99-4b56-adec-74c7b1f90e55 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:45.979194 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-af461fcf-8a99-4b56-adec-74c7b1f90e55 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:45.985963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af461fcf-8a99-4b56-adec-74c7b1f90e55 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:45.986359 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af461fcf-8a99-4b56-adec-74c7b1f90e55 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:45.987136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af461fcf-8a99-4b56-adec-74c7b1f90e55 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:45.987615 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-af461fcf-8a99-4b56-adec-74c7b1f90e55 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:46.012570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-af461fcf-8a99-4b56-adec-74c7b1f90e55 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/ips" status: 200 len: 144 microversion: 2.1 time: 0.286878 Jul 02 03:51:46.013128 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 548/1106] 10.222.0.42 () {58 vars in 1247 bytes} [Sat Jul 2 03:51:45 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/ips => generated 144 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:51:47.350885 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=32 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:47.351668 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:51:47.356135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5458bbff-af21-4e0b-9c42-b1378b0d0dc4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05c0f13f-42a4-4c1e-99bb-f395fd675c66"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:51:47.357138 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5458bbff-af21-4e0b-9c42-b1378b0d0dc4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:47.365214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5458bbff-af21-4e0b-9c42-b1378b0d0dc4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:47.365720 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5458bbff-af21-4e0b-9c42-b1378b0d0dc4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:47.366569 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5458bbff-af21-4e0b-9c42-b1378b0d0dc4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:47.366997 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5458bbff-af21-4e0b-9c42-b1378b0d0dc4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:47.648859 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5458bbff-af21-4e0b-9c42-b1378b0d0dc4 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299281 Jul 02 03:51:47.649451 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 559/1107] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:51:47 2022] POST /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:51:55.211538 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7cd50cac-dda8-4178-9303-55f023a0849a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:55.212996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7cd50cac-dda8-4178-9303-55f023a0849a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:55.220808 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7cd50cac-dda8-4178-9303-55f023a0849a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:55.221260 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7cd50cac-dda8-4178-9303-55f023a0849a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:55.222035 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7cd50cac-dda8-4178-9303-55f023a0849a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:55.222467 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7cd50cac-dda8-4178-9303-55f023a0849a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:55.255963 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7cd50cac-dda8-4178-9303-55f023a0849a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049163 Jul 02 03:51:55.256531 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 549/1108] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:51:55 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:51:55.267924 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-aa93ec3e-5100-4b67-956c-70da67db6e89 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:51:55.268495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-aa93ec3e-5100-4b67-956c-70da67db6e89 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:55.275149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa93ec3e-5100-4b67-956c-70da67db6e89 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:55.275632 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa93ec3e-5100-4b67-956c-70da67db6e89 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:55.276567 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa93ec3e-5100-4b67-956c-70da67db6e89 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:55.276875 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-aa93ec3e-5100-4b67-956c-70da67db6e89 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:55.306609 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-aa93ec3e-5100-4b67-956c-70da67db6e89 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/05c0f13f-42a4-4c1e-99bb-f395fd675c66" status: 200 len: 194 microversion: 2.1 time: 0.043625 Jul 02 03:51:55.307234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 560/1109] 10.222.0.42 () {58 vars in 1412 bytes} [Sat Jul 2 03:51:55 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/05c0f13f-42a4-4c1e-99bb-f395fd675c66 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:51:56.651419 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f1260805-5718-40cf-8b04-184ac8202729 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3207dd5c-35f9-48e5-b33a-6b5741524c25"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:51:56.653080 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f1260805-5718-40cf-8b04-184ac8202729 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:51:56.663483 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f1260805-5718-40cf-8b04-184ac8202729 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:56.664185 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f1260805-5718-40cf-8b04-184ac8202729 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:56.665397 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f1260805-5718-40cf-8b04-184ac8202729 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:51:56.666066 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f1260805-5718-40cf-8b04-184ac8202729 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:51:56.956122 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f1260805-5718-40cf-8b04-184ac8202729 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "POST /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311011 Jul 02 03:51:56.956716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 550/1110] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:51:56 2022] POST /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:52:04.526216 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-d35c1e52-e97b-466d-8aa9-09c8cf35769f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:04.527243 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-d35c1e52-e97b-466d-8aa9-09c8cf35769f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:04.536600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d35c1e52-e97b-466d-8aa9-09c8cf35769f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:04.537054 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d35c1e52-e97b-466d-8aa9-09c8cf35769f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:04.537854 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d35c1e52-e97b-466d-8aa9-09c8cf35769f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:04.538287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-d35c1e52-e97b-466d-8aa9-09c8cf35769f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:04.580681 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-d35c1e52-e97b-466d-8aa9-09c8cf35769f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058017 Jul 02 03:52:04.581600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 561/1111] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:52:04 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:52:04.741392 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d83c2f4a-1058-48a7-b59d-d904dd36188f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:04.741988 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d83c2f4a-1058-48a7-b59d-d904dd36188f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:04.749248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d83c2f4a-1058-48a7-b59d-d904dd36188f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:04.749691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d83c2f4a-1058-48a7-b59d-d904dd36188f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:04.750451 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d83c2f4a-1058-48a7-b59d-d904dd36188f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:04.750878 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d83c2f4a-1058-48a7-b59d-d904dd36188f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:04.780455 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d83c2f4a-1058-48a7-b59d-d904dd36188f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/05c0f13f-42a4-4c1e-99bb-f395fd675c66" status: 200 len: 194 microversion: 2.1 time: 0.045308 Jul 02 03:52:04.781032 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 551/1112] 10.222.0.42 () {58 vars in 1412 bytes} [Sat Jul 2 03:52:04 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/05c0f13f-42a4-4c1e-99bb-f395fd675c66 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:52:04.795675 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:04.796288 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:04.806262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:04.806844 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:04.808024 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:04.808815 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:04.896898 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lazy-loading 'services' on Instance uuid 4e19df2f-a704-4cba-93a1-031ac21b3998 {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:52:04.980777 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-cb3a99db-878c-48a7-a88e-e2514971ca5a tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/05c0f13f-42a4-4c1e-99bb-f395fd675c66" status: 202 len: 0 microversion: 2.1 time: 0.191287 Jul 02 03:52:04.981848 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 562/1113] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:52:04 2022] DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/05c0f13f-42a4-4c1e-99bb-f395fd675c66 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:52:07.161801 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f12f79c3-82c3-4439-9a11-4228c2370bde tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:07.162351 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f12f79c3-82c3-4439-9a11-4228c2370bde tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:07.169583 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f12f79c3-82c3-4439-9a11-4228c2370bde tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:07.170028 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f12f79c3-82c3-4439-9a11-4228c2370bde tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:07.170787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f12f79c3-82c3-4439-9a11-4228c2370bde tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:07.171216 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f12f79c3-82c3-4439-9a11-4228c2370bde tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:07.202776 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f12f79c3-82c3-4439-9a11-4228c2370bde tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/3207dd5c-35f9-48e5-b33a-6b5741524c25" status: 200 len: 194 microversion: 2.1 time: 0.044968 Jul 02 03:52:07.203360 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 552/1114] 10.222.0.42 () {58 vars in 1412 bytes} [Sat Jul 2 03:52:07 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/3207dd5c-35f9-48e5-b33a-6b5741524c25 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:52:07.217620 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:07.218234 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:07.228975 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:07.229467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:07.230495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:07.231164 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:07.324292 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.objects.instance [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lazy-loading 'services' on Instance uuid 4e19df2f-a704-4cba-93a1-031ac21b3998 {{(pid=124512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:52:07.411364 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a2c7a535-fbb2-4106-8c7a-40ee908a5df2 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/3207dd5c-35f9-48e5-b33a-6b5741524c25" status: 202 len: 0 microversion: 2.1 time: 0.200966 Jul 02 03:52:07.412097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 563/1115] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:52:07 2022] DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments/3207dd5c-35f9-48e5-b33a-6b5741524c25 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:52:08.589869 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-3576db04-a9dc-4c08-bb41-33d1daff7623 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:08.590810 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-3576db04-a9dc-4c08-bb41-33d1daff7623 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:08.597953 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3576db04-a9dc-4c08-bb41-33d1daff7623 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.598410 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3576db04-a9dc-4c08-bb41-33d1daff7623 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:08.599183 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3576db04-a9dc-4c08-bb41-33d1daff7623 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.599666 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-3576db04-a9dc-4c08-bb41-33d1daff7623 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:08.629244 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-3576db04-a9dc-4c08-bb41-33d1daff7623 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043469 Jul 02 03:52:08.629778 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 553/1116] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:52:08 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:52:08.735824 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-3e81f035-6804-4629-9274-0703897ab938 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:08.736826 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-3e81f035-6804-4629-9274-0703897ab938 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:08.743265 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3e81f035-6804-4629-9274-0703897ab938 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.743751 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3e81f035-6804-4629-9274-0703897ab938 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:08.744511 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3e81f035-6804-4629-9274-0703897ab938 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.744947 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-3e81f035-6804-4629-9274-0703897ab938 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:08.773945 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-3e81f035-6804-4629-9274-0703897ab938 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042946 Jul 02 03:52:08.774491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 564/1117] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:52:08 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:52:08.833576 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:08.834079 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:08.840482 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.840935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:08.841697 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.842133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:08.866948 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Going to try to terminate instance {{(pid=124513) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:52:08.955115 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-10438c5a-1f27-4395-b4d4-83dd56803406 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 204 len: 0 microversion: 2.1 time: 0.125087 Jul 02 03:52:08.955904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 554/1118] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:52:08 2022] DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:52:08.964175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:08.964783 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:08.970775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.971223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:08.972152 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:08.972564 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:09.118967 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:52:09.128564 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-43f043d5-2622-471b-94eb-f6c2013ca47f tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1671 microversion: 2.1 time: 0.168260 Jul 02 03:52:09.129357 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 565/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:52:08 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:52:10.149162 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:10.149847 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:10.156752 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:10.157195 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:10.157950 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:10.158380 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:10.297753 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:52:10.309256 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-b304f68c-6896-4b46-93cc-3264c9daf89b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1671 microversion: 2.1 time: 0.164107 Jul 02 03:52:10.310037 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 555/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:52:10 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:52:11.326571 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:11.327176 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:11.334132 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:11.334579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:11.335382 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:11.335818 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:11.473861 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80e09005b7e4cdc8f42be866dbd91bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0665267ba574490cbcf958be4d793dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:52:11.481478 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-18f984af-8321-4723-9cec-a8a19f61b85d tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 200 len: 1671 microversion: 2.1 time: 0.158853 Jul 02 03:52:11.482043 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 566/1121] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:52:11 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:52:11.873637 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-789e6467-89f6-4067-86a5-d620a3fca2f6 req-4e26e245-ffab-42f6-bfaa-2e55ee7b5221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e19df2f-a704-4cba-93a1-031ac21b3998", "name": "network-vif-deleted", "tag": "26c8b138-e3db-46c8-b558-dc25b48aed1b"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:52:11.883083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-789e6467-89f6-4067-86a5-d620a3fca2f6 req-4e26e245-ffab-42f6-bfaa-2e55ee7b5221 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:11.883565 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-789e6467-89f6-4067-86a5-d620a3fca2f6 req-4e26e245-ffab-42f6-bfaa-2e55ee7b5221 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:11.896049 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-789e6467-89f6-4067-86a5-d620a3fca2f6 req-4e26e245-ffab-42f6-bfaa-2e55ee7b5221 service nova] Creating event network-vif-deleted:26c8b138-e3db-46c8-b558-dc25b48aed1b for instance 4e19df2f-a704-4cba-93a1-031ac21b3998 on hv-cinder-84684 Jul 02 03:52:11.901603 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-789e6467-89f6-4067-86a5-d620a3fca2f6 req-4e26e245-ffab-42f6-bfaa-2e55ee7b5221 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 Jul 02 03:52:11.902540 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 556/1122] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:52:12.498987 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:12.499624 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:12.506467 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:12.506911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:12.507702 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:12.508134 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:12.521883 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] HTTP exception thrown: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Request method failure captured: Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 HTTP/1.1 Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv79h1c93TZjcNcKGnA1ji0XJClw4hnMhduQ2JAbEByx-gOn3AI37RJRI9wlBibfmCbEZV9Ykri5By48Ki86bNpGaRLvpF3-50i2OSWGaNz2wY1DwNs8SiR3apyua9-sDdvNmMwG0_JV_kSPO8pYmC3ZfJ-iaIXgrDxwff_ThDefCVWU Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:52:12.523358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0665267ba574490cbcf958be4d793dd3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: e80e09005b7e4cdc8f42be866dbd91bb Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:12.524907 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '4e19df2f-a704-4cba-93a1-031ac21b3998'} Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:52:12.525768 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:12.527119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:12.529191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Returning 404 to user: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:52:12.529191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-317d4da0-ab43-4968-9b11-ebf2a0d39f0e tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 404 len: 111 microversion: 2.1 time: 0.029969 Jul 02 03:52:12.529191 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 567/1123] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:52:12 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:52:12.534577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-46ec5ca9-54fa-40fe-a360-d4c826304ee1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '.version_select at 0x7f2e9c076160>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:12.554828 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-46ec5ca9-54fa-40fe-a360-d4c826304ee1 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384341555" status: 202 len: 0 microversion: 2.1 time: 0.024429 Jul 02 03:52:12.555748 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 557/1124] 10.222.0.42 () {58 vars in 1220 bytes} [Sat Jul 2 03:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384341555 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:52:15.524003 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:15.524576 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:15.531526 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:15.531979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:15.532740 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:15.533175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:15.547428 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] HTTP exception thrown: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Request method failure captured: Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 HTTP/1.1 Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv79h1c93TZjcNcKGnA1ji0XJClw4hnMhduQ2JAbEByx-gOn3AI37RJRI9wlBibfmCbEZV9Ykri5By48Ki86bNpGaRLvpF3-50i2OSWGaNz2wY1DwNs8SiR3apyua9-sDdvNmMwG0_JV_kSPO8pYmC3ZfJ-iaIXgrDxwff_ThDefCVWU Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:52:15.548964 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0665267ba574490cbcf958be4d793dd3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: e80e09005b7e4cdc8f42be866dbd91bb Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.550780 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': '4e19df2f-a704-4cba-93a1-031ac21b3998'} Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:52:15.551807 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.553396 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.555540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Returning 404 to user: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:52:15.555540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f3117638-fced-4d2c-abdd-c751c261444b tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 404 len: 111 microversion: 2.1 time: 0.030319 Jul 02 03:52:15.555540 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 568/1125] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:52:15 2022] DELETE /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:52:15.562547 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:15.563794 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: 4e19df2f-a704-4cba-93a1-031ac21b3998] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:15.570751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:15.571196 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:15.571985 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:15.572416 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:15.585907 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] HTTP exception thrown: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Request method failure captured: Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 HTTP/1.1 Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv79h1c93TZjcNcKGnA1ji0XJClw4hnMhduQ2JAbEByx-gOn3AI37RJRI9wlBibfmCbEZV9Ykri5By48Ki86bNpGaRLvpF3-50i2OSWGaNz2wY1DwNs8SiR3apyua9-sDdvNmMwG0_JV_kSPO8pYmC3ZfJ-iaIXgrDxwff_ThDefCVWU Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:52:15.587584 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0665267ba574490cbcf958be4d793dd3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: e80e09005b7e4cdc8f42be866dbd91bb Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.589140 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': '4e19df2f-a704-4cba-93a1-031ac21b3998'} Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:52:15.590044 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. Jul 02 03:52:15.591674 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:15.593104 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Returning 404 to user: Instance 4e19df2f-a704-4cba-93a1-031ac21b3998 could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:52:15.593104 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a78b0567-fba9-478f-97e3-cc555f9663c3 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998" status: 404 len: 111 microversion: 2.1 time: 0.033778 Jul 02 03:52:15.593104 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 558/1126] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:52:15 2022] GET /compute/v2.1/servers/4e19df2f-a704-4cba-93a1-031ac21b3998 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:52:16.745524 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:16.746078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:16.753174 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:16.753617 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:16.754373 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:16.754798 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:16.769782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.wsgi [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] HTTP exception thrown: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Request method failure captured: Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: request: DELETE /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba HTTP/1.1 Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept: application/json Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Accept-Encoding: identity Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Connection: close Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Length: 0 Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Content-Type: application/json Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Host: 10.222.0.42 Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Openstack-System-Scope: None Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: User-Agent: python-urllib3/1.26.9 Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Auth-Token: gAAAAABiv79h1c93TZjcNcKGnA1ji0XJClw4hnMhduQ2JAbEByx-gOn3AI37RJRI9wlBibfmCbEZV9Ykri5By48Ki86bNpGaRLvpF3-50i2OSWGaNz2wY1DwNs8SiR3apyua9-sDdvNmMwG0_JV_kSPO8pYmC3ZfJ-iaIXgrDxwff_ThDefCVWU Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Id: None Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Domain-Name: None Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Identity-Status: Confirmed Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Is-Admin-Project: True Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Id: default Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Domain-Name: Default Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Project-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Role: reader,member Jul 02 03:52:16.771333 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Roles: reader,member Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0665267ba574490cbcf958be4d793dd3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Id: default Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Domain-Name: Default Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Id: e80e09005b7e4cdc8f42be866dbd91bb Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: X-User-Name: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: method: > Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: exception: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.773056 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: action_args: {'id': 'c7f0da2c-7771-4e9c-9dfd-e5a12e452bba'} Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:52:16.773988 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.775548 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.777199 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Returning 404 to user: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. {{(pid=124512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:52:16.777199 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-33d887e2-aeaf-4914-b393-4d9e4d2fcb60 tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 404 len: 111 microversion: 2.1 time: 0.031076 Jul 02 03:52:16.777199 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 569/1127] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:52:16 2022] DELETE /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:52:16.781222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:52:16.781842 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] [instance: c7f0da2c-7771-4e9c-9dfd-e5a12e452bba] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:52:16.784330 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:52:16.789918 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:16.790362 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:16.791136 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:52:16.791927 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:52:16.796029 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:52:16.808095 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] HTTP exception thrown: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Request method failure captured: Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba HTTP/1.1 Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv79h1c93TZjcNcKGnA1ji0XJClw4hnMhduQ2JAbEByx-gOn3AI37RJRI9wlBibfmCbEZV9Ykri5By48Ki86bNpGaRLvpF3-50i2OSWGaNz2wY1DwNs8SiR3apyua9-sDdvNmMwG0_JV_kSPO8pYmC3ZfJ-iaIXgrDxwff_ThDefCVWU Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:52:16.809677 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0665267ba574490cbcf958be4d793dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0665267ba574490cbcf958be4d793dd3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 0665267ba574490cbcf958be4d793dd3 Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-732897671 Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: e80e09005b7e4cdc8f42be866dbd91bb Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-AttachVolumeTestJSON-732897671-project Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.811214 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'c7f0da2c-7771-4e9c-9dfd-e5a12e452bba'} Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:52:16.812078 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. Jul 02 03:52:16.813393 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:52:16.814566 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] Returning 404 to user: Instance c7f0da2c-7771-4e9c-9dfd-e5a12e452bba could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:52:16.814566 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6805ae28-4240-4a9b-a9d3-4ad63c5b136c tempest-AttachVolumeTestJSON-732897671 tempest-AttachVolumeTestJSON-732897671-project] 10.222.0.42 "GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba" status: 404 len: 111 microversion: 2.1 time: 0.033735 Jul 02 03:52:16.814566 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 559/1128] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:52:16 2022] GET /compute/v2.1/servers/c7f0da2c-7771-4e9c-9dfd-e5a12e452bba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 03:52:45.124725 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:52:45.125273 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 03:52:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:54:22.053621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79880ad7-53f3-4f46-a7a2-67fc0d381df4] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 03:54:22.054287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=22 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:54:22.054972 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:54:22.059010 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7cfe5c8b-65b1-476c-a37d-58a1b917eea9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Action: 'create', calling method: .version_select at 0x7f2e9759a1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-401081736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7ivMDQULcSq6B2W343b5boO3RHiVKV2pPdhUlopB06bkzYweOJR3Le7PjI5wRjrJZ7EvPhKciJiKQIPyLS0h2BcqP9T6BfWDtWpodMGBzvp62JKDEuwGOoWPcIi6CbuQ=="}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:54:22.075001 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-7cfe5c8b-65b1-476c-a37d-58a1b917eea9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Getting quotas for project 642a93dd7b34496491123f30dce4438d. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:54:22.079009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.quota [None req-7cfe5c8b-65b1-476c-a37d-58a1b917eea9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Getting quotas for user ed4e5bbc53a74f7083525adc968db049 and project 642a93dd7b34496491123f30dce4438d. Resources: {'key_pairs'} {{(pid=124512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:54:22.091495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7cfe5c8b-65b1-476c-a37d-58a1b917eea9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [c962c284-e76c-43b8-b129-c1f85b8f71be] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 03:54:23.063114 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] [79880ad7-53f3-4f46-a7a2-67fc0d381df4] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41712. Jul 02 03:54:23.098586 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [None req-7cfe5c8b-65b1-476c-a37d-58a1b917eea9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [c962c284-e76c-43b8-b129-c1f85b8f71be] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41714. Jul 02 03:54:23.275629 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7cfe5c8b-65b1-476c-a37d-58a1b917eea9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.224034 Jul 02 03:54:23.276298 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 570/1129] 10.222.0.42 () {60 vars in 1158 bytes} [Sat Jul 2 03:54:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:54:23.327394 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:54:23.331813 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1466811766", "imageRef": "2a1fe000-a100-4df3-a2d2-8f2905b08d98", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-401081736", "networks": [{"uuid": "4f4eafb2-33a1-4dfe-af4b-8fa223f41fa1"}]}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:54:23.387088 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.network.neutron [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] validate_networks() for [('4f4eafb2-33a1-4dfe-af4b-8fa223f41fa1', None, None, None, None, None)] {{(pid=124513) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 03:54:23.867654 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Flavor limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 03:54:23.868090 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Image limits 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 03:54:23.868572 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Flavor pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 03:54:23.868994 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Image pref 0:0:0 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 03:54:23.869680 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.virt.hardware [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 03:54:23.879453 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:23.879911 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:23.880726 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:23.881170 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:23.898508 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Getting quotas for project 642a93dd7b34496491123f30dce4438d. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 03:54:23.903158 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.quota [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Getting quotas for user ed4e5bbc53a74f7083525adc968db049 and project 642a93dd7b34496491123f30dce4438d. Resources: {'ram', 'instances', 'cores'} {{(pid=124513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 03:54:23.919688 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Going to run 1 instances... {{(pid=124513) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 03:54:23.921901 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a1fe000-a100-4df3-a2d2-8f2905b08d98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 03:54:23.966942 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [b395e313-bf97-4d81-aeb8-8c3ee5f69695] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 03:54:24.980176 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [b395e313-bf97-4d81-aeb8-8c3ee5f69695] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41732. Jul 02 03:54:24.985156 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-95527efb-c258-4673-a03c-243dbb98ee22 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659966 Jul 02 03:54:24.985830 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 560/1130] 10.222.0.42 () {60 vars in 1146 bytes} [Sat Jul 2 03:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 03:54:24.996478 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4bef37b7-40fe-4f26-9947-e062251dcf0f tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:24.997043 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4bef37b7-40fe-4f26-9947-e062251dcf0f tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:25.053534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4bef37b7-40fe-4f26-9947-e062251dcf0f tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:25.060567 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4bef37b7-40fe-4f26-9947-e062251dcf0f tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1258 microversion: 2.1 time: 0.068657 Jul 02 03:54:25.061167 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 571/1131] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:24 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:26.082988 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-fba7a11e-a22c-4468-a8fa-e89a7b10b4a9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:26.083699 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-fba7a11e-a22c-4468-a8fa-e89a7b10b4a9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:26.144245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-fba7a11e-a22c-4468-a8fa-e89a7b10b4a9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:26.154232 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-fba7a11e-a22c-4468-a8fa-e89a7b10b4a9 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1258 microversion: 2.1 time: 0.075980 Jul 02 03:54:26.154786 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 561/1132] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:26 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:27.173684 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-36cd014d-09b9-405b-ab96-6b4d25bff0cf tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:27.174558 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-36cd014d-09b9-405b-ab96-6b4d25bff0cf tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:27.236482 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-36cd014d-09b9-405b-ab96-6b4d25bff0cf tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:27.243757 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-36cd014d-09b9-405b-ab96-6b4d25bff0cf tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1258 microversion: 2.1 time: 0.076074 Jul 02 03:54:27.244317 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 572/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:27 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:28.263930 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:28.264867 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:28.276007 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:28.276743 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:28.277997 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:28.279021 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:28.343084 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:28.354061 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-6bd14109-45da-491e-b5b0-7d3d4f7f3439 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1262 microversion: 2.1 time: 0.096436 Jul 02 03:54:28.354835 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 562/1134] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:28 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:29.375970 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:29.376930 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:29.390457 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:29.390911 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:29.391721 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:29.392155 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:29.457880 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:29.468110 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4f8ea81b-e202-459d-893d-a822f00d71af tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1318 microversion: 2.1 time: 0.098585 Jul 02 03:54:29.469607 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 573/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:29 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:30.485931 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:30.486579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:30.494273 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:30.495120 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:30.496243 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:30.496777 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:30.641150 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:30.648996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-76fdc914-3c26-4ba2-9a5e-171bc02502c3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.167110 Jul 02 03:54:30.649582 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 563/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:30 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:31.667135 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:31.667790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:31.674574 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:31.675328 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:31.676214 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:31.676729 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:31.827703 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:31.835424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-4f9ca972-a5a1-402a-a301-e5dc0cc3a612 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.172590 Jul 02 03:54:31.835945 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 574/1137] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:31 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:32.853507 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:32.854109 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:32.861586 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:32.862047 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:32.862862 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:32.863324 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:33.002579 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:33.010236 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-889413b8-e797-427d-b226-dcbd4b2bc75b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.160695 Jul 02 03:54:33.011036 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 564/1138] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:32 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:34.028627 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:34.030170 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:34.039529 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:34.040489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:34.041609 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:34.042046 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:34.178605 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:34.186400 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-68a79364-614f-47bf-8628-9980c17fd1db tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.161688 Jul 02 03:54:34.186962 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 575/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:34 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:35.202973 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:35.203816 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:35.210113 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:54:35.212389 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:35.213133 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:35.214067 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:35.214769 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:35.350855 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:35.359691 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-974a3e16-3ab3-4f07-ac82-0651e84c160e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.160602 Jul 02 03:54:35.360271 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 565/1140] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:35 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:36.376885 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:36.377600 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:36.384687 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:36.385138 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:36.385923 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:36.386359 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:36.524516 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:36.535332 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-ca545dce-5b2c-4405-a430-a96cd4f76cfc tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.162952 Jul 02 03:54:36.535903 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 576/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:36 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:37.553472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:37.554164 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:37.556509 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=8 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:54:37.563050 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:37.563708 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:37.564492 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:37.564924 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:37.699962 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:37.707886 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-c8132a94-5350-42d1-b34e-2995e0e9ffa1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.158868 Jul 02 03:54:37.708577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 566/1142] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:37 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:38.729231 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:38.730255 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:38.733153 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell0:SELECT=8 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:54:38.739775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:38.740223 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:38.740979 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:38.741415 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:38.882372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:38.890694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-f146d1f2-59a2-42f7-ba4a-8fe889854479 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.168025 Jul 02 03:54:38.891259 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 577/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:38 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:39.912475 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:39.913486 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:39.924062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:39.924505 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:39.925267 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:39.925694 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:40.055083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:40.066313 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-0b034c84-c67a-4786-b95e-d474f5b829b2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.160687 Jul 02 03:54:40.066982 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 567/1144] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:39 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:41.084460 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:41.085958 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:41.093731 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:41.094597 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:41.103849 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-b5991e53-5caf-49f7-84d6-6349b3cefd8d req-4e92f0f9-d8a5-45fe-81f5-ffcdaea91d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce", "tag": "13ba5ae6-b27d-44f8-856e-b4469a548e86"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:54:41.118259 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:41.118714 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:41.126670 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-b5991e53-5caf-49f7-84d6-6349b3cefd8d req-4e92f0f9-d8a5-45fe-81f5-ffcdaea91d43 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:41.127202 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-b5991e53-5caf-49f7-84d6-6349b3cefd8d req-4e92f0f9-d8a5-45fe-81f5-ffcdaea91d43 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:41.153820 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-b5991e53-5caf-49f7-84d6-6349b3cefd8d req-4e92f0f9-d8a5-45fe-81f5-ffcdaea91d43 service nova] Creating event network-changed:13ba5ae6-b27d-44f8-856e-b4469a548e86 for instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce on hv-cinder-84684 Jul 02 03:54:41.159644 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-b5991e53-5caf-49f7-84d6-6349b3cefd8d req-4e92f0f9-d8a5-45fe-81f5-ffcdaea91d43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059393 Jul 02 03:54:41.163716 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 568/1145] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:54:41.271718 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:41.279535 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-41813c7f-7b50-4856-824b-462b067899aa tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.199146 Jul 02 03:54:41.280097 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 578/1146] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:41 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:42.301659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:42.302504 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:42.310702 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:42.311262 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:42.312248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:42.312787 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:42.457968 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:42.465744 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-9cb6f0b8-53d0-4885-b5ba-adb462fe481b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.171084 Jul 02 03:54:42.466280 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 569/1147] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:42 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:43.486799 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:43.487855 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:43.498791 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:43.499583 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:43.500835 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:43.501535 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:43.637682 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:43.647225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-648279f3-40d3-4139-a202-9596ed5cb345 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.166977 Jul 02 03:54:43.647821 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 579/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:43 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:44.668331 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:44.669217 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:44.677604 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:44.678049 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:44.678809 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:44.679238 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:44.829780 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:44.837767 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-e27c7c02-40a3-47f1-8b69-42a7b74f48f0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.176519 Jul 02 03:54:44.838511 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 570/1149] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:44 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:45.855118 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:45.855714 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:45.863491 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:45.863927 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:45.864689 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:45.865119 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:45.996809 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:46.009207 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e62f65f9-c6d3-40b6-aef6-4240ee6ae579 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.157923 Jul 02 03:54:46.010054 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 580/1150] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:45 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:47.033343 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:47.034415 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:47.042999 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:47.043588 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:47.044563 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:47.045100 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:47.186009 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:47.193913 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7029dcd5-df7a-4664-b309-f7eb837612f7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.167298 Jul 02 03:54:47.194475 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 571/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:47 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:47.526936 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:54:47.527908 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 03:54:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:54:47.904497 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-69a8e2ab-b519-4129-95b3-3d1a71d419e4 req-0de129d6-5a82-4585-9d6a-72094efcf838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce", "name": "network-vif-plugged", "status": "completed", "tag": "13ba5ae6-b27d-44f8-856e-b4469a548e86"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:54:47.913033 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-69a8e2ab-b519-4129-95b3-3d1a71d419e4 req-0de129d6-5a82-4585-9d6a-72094efcf838 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:47.913537 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-69a8e2ab-b519-4129-95b3-3d1a71d419e4 req-0de129d6-5a82-4585-9d6a-72094efcf838 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:47.924899 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-69a8e2ab-b519-4129-95b3-3d1a71d419e4 req-0de129d6-5a82-4585-9d6a-72094efcf838 service nova] Creating event network-vif-plugged:13ba5ae6-b27d-44f8-856e-b4469a548e86 for instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce on hv-cinder-84684 Jul 02 03:54:47.931099 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-69a8e2ab-b519-4129-95b3-3d1a71d419e4 req-0de129d6-5a82-4585-9d6a-72094efcf838 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155792 Jul 02 03:54:47.931836 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 581/1152] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:54:48.210761 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:48.211401 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:48.218598 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:48.219041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:48.219834 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:48.220400 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:48.363222 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:48.375368 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-db574822-5a70-47b4-b28e-57d64cde2712 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.168253 Jul 02 03:54:48.376097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 572/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:48 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:49.403233 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:49.404562 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:49.414205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:49.414725 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:49.415568 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:49.416362 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:49.551796 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:49.559447 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-69d01289-c38f-40ac-b325-2074f4c0fdba tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1358 microversion: 2.1 time: 0.164518 Jul 02 03:54:49.560037 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 582/1154] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:49 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:50.576984 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:50.577649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:50.584713 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:50.585185 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:50.585949 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:50.586425 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:50.730474 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:50.738438 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-f283d2c2-083a-4d5e-8e3e-d4187f0ef4ee tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1548 microversion: 2.1 time: 0.165373 Jul 02 03:54:50.739011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 573/1155] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:50 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:50.755315 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:50.755922 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:50.762594 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:50.763050 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:50.763840 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:50.764279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:50.901287 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:50.909278 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-b74ae4eb-67ed-4fde-9561-64e73bbaffb0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1548 microversion: 2.1 time: 0.158356 Jul 02 03:54:50.909838 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 583/1156] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:50 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:50.926051 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:50.929479 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:50.930247 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Searching by: {'deleted': False, 'project_id': '642a93dd7b34496491123f30dce4438d'} {{(pid=124513) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 03:54:50.937589 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:50.938029 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:50.938845 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:50.939498 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:51.027623 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.multi_cell_list [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 03:54:51.123179 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d6f9960c-636d-4a7d-a441-96b09b892b0e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201228 Jul 02 03:54:51.123793 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 574/1157] 10.222.0.42 () {58 vars in 1124 bytes} [Sat Jul 2 03:54:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:54:51.134121 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:54:51.134736 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:51.141534 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:51.141981 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:51.142795 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:51.143250 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:51.292759 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:54:51.300410 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-7ac26283-5210-4c43-9286-f491cf548e2e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1548 microversion: 2.1 time: 0.170228 Jul 02 03:54:51.301463 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 584/1158] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:54:51 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:54:52.838867 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-33c38b87-73d1-4129-a962-a46bfa7f5967 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6387b7c0-8be0-43f3-b132-ffd24e5050bf"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:54:52.839961 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-33c38b87-73d1-4129-a962-a46bfa7f5967 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:54:52.846926 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33c38b87-73d1-4129-a962-a46bfa7f5967 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:52.847374 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33c38b87-73d1-4129-a962-a46bfa7f5967 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:52.848175 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33c38b87-73d1-4129-a962-a46bfa7f5967 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:54:52.848614 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-33c38b87-73d1-4129-a962-a46bfa7f5967 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:54:53.145744 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-33c38b87-73d1-4129-a962-a46bfa7f5967 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310683 Jul 02 03:54:53.146346 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 575/1159] 10.222.0.42 () {60 vars in 1322 bytes} [Sat Jul 2 03:54:52 2022] POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:55:00.757694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:55:00.758377 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:55:00.760611 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:55:00.766129 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:00.766579 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:00.767347 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:00.767836 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:00.771264 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=69 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:55:00.903432 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:55:00.911547 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-2eb9047c-8e8d-44e5-a678-b5fbf075339e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1594 microversion: 2.1 time: 0.158154 Jul 02 03:55:00.912117 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 585/1160] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:55:00 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:55:02.842209 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell0:SELECT=2 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:55:02.846826 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:55:02.914497 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-0e1adcb6-9a14-467e-acb0-2469b39b0e4d req-a5473e29-7f90-4fe9-9e05-8be361921db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce", "tag": "13ba5ae6-b27d-44f8-856e-b4469a548e86"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:55:02.923950 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-0e1adcb6-9a14-467e-acb0-2469b39b0e4d req-a5473e29-7f90-4fe9-9e05-8be361921db1 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:02.924744 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-0e1adcb6-9a14-467e-acb0-2469b39b0e4d req-a5473e29-7f90-4fe9-9e05-8be361921db1 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:02.929659 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:55:02.938829 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-0e1adcb6-9a14-467e-acb0-2469b39b0e4d req-a5473e29-7f90-4fe9-9e05-8be361921db1 service nova] Creating event network-changed:13ba5ae6-b27d-44f8-856e-b4469a548e86 for instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce on hv-cinder-84684 Jul 02 03:55:02.945185 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-0e1adcb6-9a14-467e-acb0-2469b39b0e4d req-a5473e29-7f90-4fe9-9e05-8be361921db1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104188 Jul 02 03:55:02.945900 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 576/1161] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:55:03.833784 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-89082210"}} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:55:03.834293 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:55:03.841672 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:03.842228 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:03.843105 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:03.843636 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:03.976125 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.network.security_group_api [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Adding security group d8c6123e-d635-4ce0-bc3d-3eb4774e239d to port 13ba5ae6-b27d-44f8-856e-b4469a548e86 Jul 02 03:55:04.361175 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-32877858-385c-47bc-b9cb-bfc5cbe72c1c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/action" status: 202 len: 0 microversion: 2.1 time: 0.531510 Jul 02 03:55:04.365779 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 586/1162] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:55:03 2022] POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:55:04.371736 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:55:04.372441 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:55:04.388556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:04.389003 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:04.389788 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:04.390226 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:04.554821 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:55:04.565042 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-de1a7231-aa05-437a-816b-b19a2c768575 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1758 microversion: 2.1 time: 0.198083 Jul 02 03:55:04.565690 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 577/1163] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:55:04 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:55:04.960668 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-0f3788a5-21dd-41a1-b22a-61aa1a75fa3a req-bd37084f-fc89-4b8e-a85b-cbfdeab5d877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce", "tag": "13ba5ae6-b27d-44f8-856e-b4469a548e86"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:55:04.970336 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-0f3788a5-21dd-41a1-b22a-61aa1a75fa3a req-bd37084f-fc89-4b8e-a85b-cbfdeab5d877 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:55:04.970955 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-0f3788a5-21dd-41a1-b22a-61aa1a75fa3a req-bd37084f-fc89-4b8e-a85b-cbfdeab5d877 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:55:04.984685 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-0f3788a5-21dd-41a1-b22a-61aa1a75fa3a req-bd37084f-fc89-4b8e-a85b-cbfdeab5d877 service nova] Creating event network-changed:13ba5ae6-b27d-44f8-856e-b4469a548e86 for instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce on hv-cinder-84684 Jul 02 03:55:04.992225 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-0f3788a5-21dd-41a1-b22a-61aa1a75fa3a req-bd37084f-fc89-4b8e-a85b-cbfdeab5d877 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035593 Jul 02 03:55:04.992808 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 587/1164] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:56:05.134950 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:56:05.137026 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 03:56:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:56:05.193345 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=4 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:56:05.194116 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=7 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:56:05.198444 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-79421172-2e8c-48ce-bcdb-fb01916d6378 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:56:05.199448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-79421172-2e8c-48ce-bcdb-fb01916d6378 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:05.206385 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-79421172-2e8c-48ce-bcdb-fb01916d6378 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:05.206841 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-79421172-2e8c-48ce-bcdb-fb01916d6378 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:05.207628 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-79421172-2e8c-48ce-bcdb-fb01916d6378 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:05.208058 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-79421172-2e8c-48ce-bcdb-fb01916d6378 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:05.287974 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-79421172-2e8c-48ce-bcdb-fb01916d6378 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/action" status: 202 len: 0 microversion: 2.1 time: 0.096114 Jul 02 03:56:05.288649 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 578/1165] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:56:05 2022] POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:56:05.296880 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=5 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:56:05.297782 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=11 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:56:05.302018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:05.302729 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:05.314324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:05.315034 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:05.316102 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:05.316543 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:05.518137 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:05.526195 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-e9bef88f-04b6-4cca-a51f-aa386b12a5a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1750 microversion: 2.1 time: 0.231881 Jul 02 03:56:05.526761 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 588/1166] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:05 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:06.549935 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:06.551061 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:06.560932 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:06.561374 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:06.562128 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:06.562556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:06.763336 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:06.771404 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-aaf59241-d6f9-46ff-99c0-4d1da9d57390 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.229524 Jul 02 03:56:06.771988 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 579/1167] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:06 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:07.792508 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:07.793741 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:07.804898 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:07.805648 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:07.806915 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:07.807446 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:07.981183 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:07.993162 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-c4ea92f2-c75a-43dd-b505-3e24c3ec8c1e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.206937 Jul 02 03:56:07.993968 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 589/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:07 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:09.014937 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:09.015706 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:09.024071 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:09.024631 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:09.025570 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:09.026107 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:09.179679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:09.189737 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-29dddf64-c296-44db-b19d-bab2cb8ac11b tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.181119 Jul 02 03:56:09.190311 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 580/1169] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:09 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:10.211014 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:10.211891 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:10.220387 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:10.220835 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:10.221595 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:10.222027 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:10.382532 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:10.392424 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1b764d85-32a9-45e4-bb9c-a1861daf369d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.188132 Jul 02 03:56:10.392982 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 590/1170] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:10 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:11.415263 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:11.416633 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:11.424461 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:11.424902 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:11.425660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:11.426087 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:11.583725 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:11.594011 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-dcf65ddf-397d-4e71-91c4-7478a1014548 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.185385 Jul 02 03:56:11.594577 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 581/1171] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:11 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:12.621280 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:12.622612 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:12.633493 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:12.634206 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:12.635542 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:12.636247 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:12.788111 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:12.798351 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-a9130fab-39cb-426c-995c-9bc87d6391a2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.183619 Jul 02 03:56:12.798909 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 591/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:12 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:13.820698 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:13.821429 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:13.828552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:13.829005 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:13.829774 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:13.830208 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:13.978897 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:13.987973 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4d06e14d-e777-44d3-a5e1-462a1935b541 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.171202 Jul 02 03:56:13.988556 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 582/1173] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:13 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:15.010054 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:15.011005 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:15.018690 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:15.019139 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:15.019935 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:15.020365 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:15.166058 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:15.175717 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-1d24f9fb-a732-4e4f-8109-ceb222ab0ca0 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.172250 Jul 02 03:56:15.176288 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 592/1174] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:15 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:16.197065 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:16.198005 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:16.209315 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:16.210053 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:16.211452 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:16.212062 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:16.365270 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:16.373650 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-a0cc14a2-4dec-4ba3-9c47-8bddc3c6391c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1755 microversion: 2.1 time: 0.183189 Jul 02 03:56:16.374210 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 583/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:16 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:56:17.391610 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:56:17.392262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:56:17.400262 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:17.400788 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:17.401616 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:56:17.402074 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:56:17.558497 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:56:17.566863 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-774afc0b-0179-4eef-88cf-f709a1ab668c tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1758 microversion: 2.1 time: 0.179554 Jul 02 03:56:17.567481 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 593/1176] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:56:17 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:57:13.152647 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:57:13.153260 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Sat Jul 2 03:57:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:57:20.911495 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_api:SELECT=12 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:57:20.912611 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG dbcounter [-] [124513] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:57:20.919791 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-89082210"}} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:57:20.920657 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:20.931797 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:20.932248 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:20.932996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:20.933428 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:21.089971 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.network.security_group_api [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Removing security group d8c6123e-d635-4ce0-bc3d-3eb4774e239d from port 13ba5ae6-b27d-44f8-856e-b4469a548e86 Jul 02 03:57:21.436608 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-4c9046a1-49be-4b08-a687-70c8108dd806 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/action" status: 202 len: 0 microversion: 2.1 time: 0.527905 Jul 02 03:57:21.440638 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 584/1177] 10.222.0.42 () {60 vars in 1277 bytes} [Sat Jul 2 03:57:20 2022] POST /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:57:21.447495 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_api:SELECT=12 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:57:21.448269 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG dbcounter [-] [124512] Writing DB stats nova_cell1:SELECT=36 {{(pid=124512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:57:21.457867 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-d60882ce-9a90-4c4c-a863-f78defc4fcab req-adacf519-ef6b-4636-9900-d34b14df68e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce", "tag": "13ba5ae6-b27d-44f8-856e-b4469a548e86"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:57:21.483018 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-d60882ce-9a90-4c4c-a863-f78defc4fcab req-adacf519-ef6b-4636-9900-d34b14df68e8 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:21.483489 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-d60882ce-9a90-4c4c-a863-f78defc4fcab req-adacf519-ef6b-4636-9900-d34b14df68e8 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:21.514462 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-d60882ce-9a90-4c4c-a863-f78defc4fcab req-adacf519-ef6b-4636-9900-d34b14df68e8 service nova] Creating event network-changed:13ba5ae6-b27d-44f8-856e-b4469a548e86 for instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce on hv-cinder-84684 Jul 02 03:57:21.520093 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-d60882ce-9a90-4c4c-a863-f78defc4fcab req-adacf519-ef6b-4636-9900-d34b14df68e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079336 Jul 02 03:57:21.521240 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 594/1178] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:57:22.603905 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:22.604472 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:22.610666 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:22.611111 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:22.611884 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:22.612314 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:22.698619 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.objects.instance [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lazy-loading 'services' on Instance uuid c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce {{(pid=124513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 03:57:22.772535 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-27f6311f-778f-48c1-b4f0-c803bcd59699 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments/6387b7c0-8be0-43f3-b132-ffd24e5050bf" status: 202 len: 0 microversion: 2.1 time: 0.173145 Jul 02 03:57:22.776359 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 585/1179] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:57:22 2022] DELETE /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments/6387b7c0-8be0-43f3-b132-ffd24e5050bf => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 03:57:22.782452 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-474c22f5-4e95-4039-a9e0-189e8007bce1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:22.783847 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-474c22f5-4e95-4039-a9e0-189e8007bce1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:22.791397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-474c22f5-4e95-4039-a9e0-189e8007bce1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:22.791879 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-474c22f5-4e95-4039-a9e0-189e8007bce1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:22.792806 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-474c22f5-4e95-4039-a9e0-189e8007bce1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:22.793232 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-474c22f5-4e95-4039-a9e0-189e8007bce1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:22.823307 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-474c22f5-4e95-4039-a9e0-189e8007bce1 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 Jul 02 03:57:22.823790 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 595/1180] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:57:22 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:57:23.536302 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [req-736d9930-09c8-4260-84bd-92226ba612a3 req-c750dd2f-21cb-4e66-81fe-66e58e6ee9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce", "tag": "13ba5ae6-b27d-44f8-856e-b4469a548e86"}]} {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:57:23.545679 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-736d9930-09c8-4260-84bd-92226ba612a3 req-c750dd2f-21cb-4e66-81fe-66e58e6ee9df service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:23.546124 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [req-736d9930-09c8-4260-84bd-92226ba612a3 req-c750dd2f-21cb-4e66-81fe-66e58e6ee9df service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:23.557245 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.compute.server_external_events [req-736d9930-09c8-4260-84bd-92226ba612a3 req-c750dd2f-21cb-4e66-81fe-66e58e6ee9df service nova] Creating event network-changed:13ba5ae6-b27d-44f8-856e-b4469a548e86 for instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce on hv-cinder-84684 Jul 02 03:57:23.562224 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [req-736d9930-09c8-4260-84bd-92226ba612a3 req-c750dd2f-21cb-4e66-81fe-66e58e6ee9df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030133 Jul 02 03:57:23.562875 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 586/1181] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:57:23.835326 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-156fa75d-b223-4e40-a971-732d8c779dd3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:23.836324 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-156fa75d-b223-4e40-a971-732d8c779dd3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:23.842433 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-156fa75d-b223-4e40-a971-732d8c779dd3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:23.842878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-156fa75d-b223-4e40-a971-732d8c779dd3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:23.843676 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-156fa75d-b223-4e40-a971-732d8c779dd3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:23.844109 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-156fa75d-b223-4e40-a971-732d8c779dd3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:23.873639 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-156fa75d-b223-4e40-a971-732d8c779dd3 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042663 Jul 02 03:57:23.878824 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 596/1182] 10.222.0.42 () {58 vars in 1301 bytes} [Sat Jul 2 03:57:23 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 03:57:23.885557 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:23.886142 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:23.892397 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:23.892854 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:23.893612 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:23.894041 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:23.968692 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] HTTP exception thrown: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce is not attached to volume 6387b7c0-8be0-43f3-b132-ffd24e5050bf Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Request method failure captured: Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: DELETE /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments/6387b7c0-8be0-43f3-b132-ffd24e5050bf HTTP/1.1 Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv8FfIFJTVxPudMspLR6q2fjDwl6MDDetx_vh8O_26h3RHcehOH4zw0qOWaTMXPnc_BF-_jlTRDS3UEAAS8yaivYwG7X7Qs1u7QMvBpbk5nMSQ9PzZkyii0B7_zz6Gll8D3KcCObFI3jxCzMILveTCxd3JVDu2oFvV3Q9mD_wbPq3syU Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 642a93dd7b34496491123f30dce4438d Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-TestMinimumBasicScenario-201774898 Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:57:23.970992 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/642a93dd7b34496491123f30dce4438d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/642a93dd7b34496491123f30dce4438d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/642a93dd7b34496491123f30dce4438d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_642a93dd7b34496491123f30dce4438d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-TestMinimumBasicScenario-201774898 Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 642a93dd7b34496491123f30dce4438d Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-TestMinimumBasicScenario-201774898 Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-TestMinimumBasicScenario-201774898-project Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: ed4e5bbc53a74f7083525adc968db049 Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-TestMinimumBasicScenario-201774898-project Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:57:23.972891 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce is not attached to volume 6387b7c0-8be0-43f3-b132-ffd24e5050bf Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'server_id': 'c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce', 'id': '6387b7c0-8be0-43f3-b132-ffd24e5050bf'} Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6387b7c0-8be0-43f3-b132-ffd24e5050bf. Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:57:23.973870 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce is not attached to volume 6387b7c0-8be0-43f3-b132-ffd24e5050bf Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce is not attached to volume 6387b7c0-8be0-43f3-b132-ffd24e5050bf Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:23.975552 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Returning 404 to user: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce is not attached to volume 6387b7c0-8be0-43f3-b132-ffd24e5050bf {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:57:23.976971 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-61187287-0326-4af2-9151-df2e53fd83de tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments/6387b7c0-8be0-43f3-b132-ffd24e5050bf" status: 404 len: 154 microversion: 2.1 time: 0.092081 Jul 02 03:57:23.976971 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 587/1183] 10.222.0.42 () {58 vars in 1415 bytes} [Sat Jul 2 03:57:23 2022] DELETE /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce/os-volume_attachments/6387b7c0-8be0-43f3-b132-ffd24e5050bf => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:57:25.122818 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:25.123481 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:25.130426 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:25.130878 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:25.131694 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:25.132127 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:25.158267 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Going to try to terminate instance {{(pid=124512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 03:57:25.244009 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-70e68ff7-fc41-423b-8810-c45513cd5ae2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 204 len: 0 microversion: 2.1 time: 0.125134 Jul 02 03:57:25.245149 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 597/1184] 10.222.0.42 () {58 vars in 1238 bytes} [Sat Jul 2 03:57:25 2022] DELETE /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 03:57:25.253408 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:25.254026 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:25.260844 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:25.261288 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:25.262057 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:25.262491 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:25.400395 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:57:25.408551 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-8a9c6aec-2795-4c9d-a4dd-2c1c5761916e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1554 microversion: 2.1 time: 0.159035 Jul 02 03:57:25.409083 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 588/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:57:25 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:57:26.429856 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:26.431185 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.compute.api [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:26.438078 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:26.438523 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:26.439279 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:26.439741 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:26.573091 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.policy [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:57:26.581205 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5ebc2423-820c-40fd-8a5e-f4716a65adc2 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1554 microversion: 2.1 time: 0.157646 Jul 02 03:57:26.581733 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 598/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:57:26 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:57:27.599092 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:27.599866 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:27.606642 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:27.607156 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:27.607956 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:27.608385 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:27.673269 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.policy [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4e5bbc53a74f7083525adc968db049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642a93dd7b34496491123f30dce4438d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124513) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 03:57:27.682617 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-7262187b-78e2-4faf-82ec-145b4c5a5ad7 tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 200 len: 1512 microversion: 2.1 time: 0.087413 Jul 02 03:57:27.683792 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 589/1187] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:57:27 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 1512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 03:57:27.823910 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [req-67b12c69-b84f-4604-a6f2-35dcb87f455c req-0d3df7d6-8197-4aa3-a23a-7a2e04d65943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce", "name": "network-vif-deleted", "tag": "13ba5ae6-b27d-44f8-856e-b4469a548e86"}]} {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 03:57:27.832397 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-67b12c69-b84f-4604-a6f2-35dcb87f455c req-0d3df7d6-8197-4aa3-a23a-7a2e04d65943 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:27.832861 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG oslo_concurrency.lockutils [req-67b12c69-b84f-4604-a6f2-35dcb87f455c req-0d3df7d6-8197-4aa3-a23a-7a2e04d65943 service nova] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:27.844179 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.compute.server_external_events [req-67b12c69-b84f-4604-a6f2-35dcb87f455c req-0d3df7d6-8197-4aa3-a23a-7a2e04d65943 service nova] Creating event network-vif-deleted:13ba5ae6-b27d-44f8-856e-b4469a548e86 for instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce on hv-cinder-84684 Jul 02 03:57:27.848770 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [req-67b12c69-b84f-4604-a6f2-35dcb87f455c req-0d3df7d6-8197-4aa3-a23a-7a2e04d65943 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137044 Jul 02 03:57:27.849358 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 599/1188] 10.222.0.42 () {64 vars in 1317 bytes} [Sat Jul 2 03:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 03:57:28.703904 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '>' {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:28.704887 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.compute.api [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] [instance: c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce] Fetching instance by UUID {{(pid=124513) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 03:57:28.714493 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:28.714944 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:28.715748 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 03:57:28.716181 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG oslo_concurrency.lockutils [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Lock "43b6b550-82d3-45fa-a0bc-b1fc6381a030" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 03:57:28.729996 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.wsgi [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] HTTP exception thrown: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce could not be found. Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Request method failure captured: Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: request: GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce HTTP/1.1 Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept: application/json Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Accept-Encoding: identity Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Connection: close Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Length: 0 Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Content-Type: application/json Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Host: 10.222.0.42 Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Openstack-System-Scope: None Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: User-Agent: python-urllib3/1.26.9 Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Auth-Token: gAAAAABiv8FfIFJTVxPudMspLR6q2fjDwl6MDDetx_vh8O_26h3RHcehOH4zw0qOWaTMXPnc_BF-_jlTRDS3UEAAS8yaivYwG7X7Qs1u7QMvBpbk5nMSQ9PzZkyii0B7_zz6Gll8D3KcCObFI3jxCzMILveTCxd3JVDu2oFvV3Q9mD_wbPq3syU Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Id: None Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Domain-Name: None Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Identity-Status: Confirmed Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Is-Admin-Project: True Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Id: default Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Domain-Name: Default Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Id: 642a93dd7b34496491123f30dce4438d Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Project-Name: tempest-TestMinimumBasicScenario-201774898 Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Role: reader,member Jul 02 03:57:28.731587 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Roles: reader,member Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/642a93dd7b34496491123f30dce4438d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/642a93dd7b34496491123f30dce4438d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/642a93dd7b34496491123f30dce4438d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_642a93dd7b34496491123f30dce4438d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant: tempest-TestMinimumBasicScenario-201774898 Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Id: 642a93dd7b34496491123f30dce4438d Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-Tenant-Name: tempest-TestMinimumBasicScenario-201774898 Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User: tempest-TestMinimumBasicScenario-201774898-project Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Id: default Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Domain-Name: Default Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Id: ed4e5bbc53a74f7083525adc968db049 Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: X-User-Name: tempest-TestMinimumBasicScenario-201774898-project Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: method: > Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: exception: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce could not be found. Jul 02 03:57:28.733301 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: action_args: {'id': 'c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce'} Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: {{(pid=124513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce could not be found. Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 03:57:28.734418 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce could not be found. Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce could not be found. Jul 02 03:57:28.736097 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: ERROR nova.api.openstack.wsgi Jul 02 03:57:28.737751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: DEBUG nova.api.openstack.wsgi [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Returning 404 to user: Instance c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce could not be found. {{(pid=124513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 03:57:28.737751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO nova.api.openstack.requestlog [None req-d1e33d69-f036-435e-9d21-274e97b5df4d tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce" status: 404 len: 111 microversion: 2.1 time: 0.035625 Jul 02 03:57:28.737751 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: [pid: 124513|app: 0|req: 590/1189] 10.222.0.42 () {58 vars in 1235 bytes} [Sat Jul 2 03:57:28 2022] GET /compute/v2.1/servers/c6ac1c40-0ae9-4b02-9f6e-f568f3a0bcce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 03:57:28.742762 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: DEBUG nova.api.openstack.wsgi [None req-5d945e9a-503f-4326-aa9e-084526eac43e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] Calling method '.version_select at 0x7f2e97547040>' {{(pid=124512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 03:57:28.763071 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO nova.api.openstack.requestlog [None req-5d945e9a-503f-4326-aa9e-084526eac43e tempest-TestMinimumBasicScenario-201774898 tempest-TestMinimumBasicScenario-201774898-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-401081736" status: 202 len: 0 microversion: 2.1 time: 0.024980 Jul 02 03:57:28.763654 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: [pid: 124512|app: 0|req: 600/1190] 10.222.0.42 () {58 vars in 1268 bytes} [Sat Jul 2 03:57:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-401081736 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 03:59:25.145775 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:59:25.146427 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 03:59:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:59:29.681768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:59:29.683448 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Sat Jul 2 03:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:59:47.542430 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:59:47.543372 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 03:59:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 03:59:52.409544 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 03:59:52.410426 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Sat Jul 2 03:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 04:00:33.162660 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 04:00:33.163372 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Sat Jul 2 04:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 04:02:45.156067 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 04:02:45.156621 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 04:02:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 04:02:48.750649 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 04:02:48.751282 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 04:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 04:02:49.695518 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 04:02:49.696768 dv-cinder-846842-9-iscsi devstack@n-api.service[124513]: Sat Jul 2 04:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 04:03:07.553156 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 04:03:07.553688 dv-cinder-846842-9-iscsi devstack@n-api.service[124512]: Sat Jul 2 04:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!